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ABSTRACT 

A curricului on the language arts was designed 
especially for hearing-iipaired students for use with 
coaputer- assisted instruction (CAI) . Basically the third-grade level 
is approxiaated in the curriculum which is designed as a 
supplementary but self-contained set of lessons. There are 214 
lessons of 20-30 exercises each, approximately sufficient for an 
entire school year. The major features of the curriculum are the 
interactive student control and the branching to different sets of 
lessons, determined by individual student needs. A feature of the 
computer program is the daily and periodic student reports which are 
available. A language arts test was developed and used in an 
evaluation experiment in which five different models of student 
progress were tested. In addition, experiments on the teaching 
strategies and sequences of tutorial CAI were performed. The latter 
experiments involved an item analysis of the lesson exercises. 
(NH) 
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J. D. Fletcher and M. H. Beard 

In June I97O, the Institute for Mathematical Studies in the Social 
Sciences (IMSSS) began a three-year project cm the development, evaluation, 
and research of computer-assisted instruction (CAI) for hearing- impaired, 
or 'deaf', students. In the course of this project over 4,000 students 
from 15 schools for the deaf in five different states received CAI in 
algebra, basic English, computer programming, elementary-school mathe- 
matics, language arts, logic, and arithmetic word problem solving 
furnished by the IMSSS computer facility at Stanford. Most of these 
curilculums were described in detail by Suppes, Goldberg, Kanz, Searle, 
and Stauffer (I97I). Overviews of IMSSS activities in CAI were provided 
by Suppes (I972), Suppes, Jeiman, and Brian (I968), and Suppes and 
Momingstar (1972). Fletcher and Stauffer (1^73), Kanz (1973), and 
Suppes (1971) specifically discussed the IMSSS project for the deaf, and 
the accomplishments of the project were summarized by Fletcher and 
Suppes (1973). The aims of the project were to demonstrate that CAI 
could be used to benefit deaf students, that it could support serious 
research in deaf education, that its economics were practicable, and, 
in general, that CAI was workable in deaf education. 

THE STANFORD CAI SYSTEM 

The central processor for the Institute's computer system is a 
Digital Equipment Corporation PCP-10. In addition to 256K of core 
memory, short-tenn storage of programs and student information is 



provided by sixteen l80 ,000 .,000- bit disk modules- Long-tem storage of 
student response data io provided by magnetic tape. About 280,000^000 
bits of infomatlon can be stored by the ::ystem on one magnetic tape. 
Communication with remote student terminals in participating schools is 
provided by private telephone lines. For communication with clusters of 
16 or more terminals, high-speed data transmission and time-division 
multiplexing are used. .Voout 90 CAI terminals can be used simultaneously 
with no appreciable detriment in the system's speed of response* Any 
curriculum or other program can be ran at any time on any student terminal* 

The student terminals are 'XSR Model 33'' teletypewriters. These 
teletypewriters provide no audio, visual^ or graphic capability, but 
their cost is about one-tenth of teraiinals that do. Despite their 
limitations, these inexpensive terminals permitted development of CAI 
that has produced dramatic gains in pedagogical achievement for hearing 
students as reported by Suppes and Morningstar (1970, 1972), Fletcher 
and Atkinson (1972), and others. For that matter, Jamison, Fletcher, 
Suppes, and Atkinson (197^) argued that for 00.-= t effectiveness, CAI, 
using satellite communication and teletypewriters, is a superior method 
for providing compensatory education. 

In a typical school. v;ne rcom con tains 8 to I5 student terminals. 
One person, the CAI terminal proctor, r/apervise.;> Ui-e of the equipment 
and students in the terminal room. Usually accompanied by their class- 
room teacher, the students enter ixnd sit at any free terminaJc Each 
student starts intf traction by pre;:sing a key to signal that he is 
positioned at the tf^rminul and ir^ ready for attention, rhe prograxf; 
responds by typing 



HI 

PLEASE TYPE YOUR NUMBER AND NAME, 
and the student responds accordingly. 

Each student receives a unique number when he enrolls for CAI, so 
the request for the first name is merely an additional safeguard to 
ensure correct iden-^fccatlon. A student can be, and usually is, en- 
rolled for several available CAI courses. He uses the same number for 
all courses and types a one-letter identifier to indicate which course 
he wants. The student in the following example types G, the identifier 
for the language arts course. Unless he types special instructions, 
the student begins exactly where he left off in the sequence of lessons. 
Student responses in the following example are underlined. 
HI 

PLEASE TYPE YOUR NUMBER AND NAME. 
03^56 MARY SMITH 

JOB 10 ON TT5013 FRI FEB 2 73 8 rUSAM-PDT 
PRONOUN LESSON PNAC 
//CHOOSE THE CORRECT PRONOUN. 
I LIKE THAT GIRL. 
I LIKE (SHE, HER). 

DESCRIPTION OF THE LANGUAGE ARTS CURRICULUI4 
Deaf students consistently score -"lower than hearing controls on 
measures of English language ability as Goetzinger and Rousey (1959); 
Miller (1958), and Moores (1970), among others, have reported. It is 
natural, therefore, that language skill subjects such as speech, 



vocabulary^ composition, grammar, reading, and speech- reading are empha- 
sized in deaf education, and the language arts curriculum was emphasized 
in the Stanford CAI project • 

The effort in the language arts program was to develop a CAI cur- 
riculum in standard Engli.->h utsage and a related paper-and-pencll test 
for students between the age:^ of 12 and 16 enrolled in special schools 
or classes for the deaf. The reading level of both the curriculum and 
the test was tailored for this population. Rawlings* U971) survey 
reported that 7^^ of the jjtudents in these schools and classes have 
suffered a hearing loss of 60 decibels or more in the better ear. Mean 
grade placement (GP) reading levels measured by the Stanford Achievement 
Test (SAT) for he a ring -impaired students 12 to l6 years of age are given 
in Table 1,"^ 

A vocabulary list was generated for the curriculum by compiling the 
words coimnon to the third-grade vocabulary lists of four widely used 
basal readers: Scott-Foresman (Pobinson, Monroe, & Artley, 1962), 
Llppinoott (McCracken & Walcutt, 1964), Ginn (Fussell & Ousley, I968), 
and Macmillan (Gates, Huber, & Salisbury, I966). Althougli words not 
found in this list were occasionally used^ an attempt was made to 
restrict the curi'iculum vocabulary to this list* The list is given in 
Appendix A, A Dictiona ry of idioms ' for the Deaf (Boatner & Gates, 1966) 
was also consulted in determining the vocabulary for the course. Teachers 
In the participating schools emphasized that Idioms are contXising to 
their students, and an attempt wus made to avoid idiomatic constmctions* 

Most language: curriculums in -schotjls ror the deaf are based on the 
. Fitzgerald Key (Fitzgerala, 19*9)- I'his syotem cla.^sifie^^ all words 
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Table 1 

Total Beeuilng Grade Equivalencies for Students with a 
Hearing-Loss Threshold of 60 Decibels and Above 
(Gentile and DiFrancesca, 1969) 









Age 






Stanford Achievement 












Test Battezy 


12 




Ik 


15 


16 


Prlmazy II 


2.41 


2.51 


2M 






Inteznediate I 


3.41 


3.46 


3.33 


3.33 


3.35 


Inte mediate II 




3.97 


4.31 


k,2k 


4.17 
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and phrases into categories identified by such words as "who,** %hat," 
•'where," and "when." Deaf students are taught standard English usage 
by identifying the Fitzgerald category to which words in question belong* 
The teacher is to foc\xs on words suggested by objects in the room or 
experiences of the students • Because this method depends heavily on 
classroom experiences and becaiise consxiltants called in to aid in the 
design of the curriculum recommended a fresh approach, the Fitzgerald 
Key was used only sparingly. 

The basic problem in teaching English to deaf students is that they 
have little or no atiral language on which to build. Unlike a hearing 
student, the deaf student is unlikely to have internalized much English 
syntax. Inflection, or vocabulary before he starts school. Rawlings* 
(1971) survey reported that 75?t of students in special classes for the 
deaf e;qperlenced hearing loss before agp three. There is a real possi- 
bility that the deaf child never assimilates the basic principles of 
English that a hearing child acquires at an early age (Charrow & Fletcher, 
ISRh; Lenneberg, 1967)# For a deaf child, learning to read is more than 
a grapheme-*to--phoneme decoding task; it is actually learning a language 
from its written fom. Learning to write standard English Is ^.xarly 
complicated for deaf students. 

The language difficulties of deaf students were carefully considered 
in developing the language arts curriculum. The curriculum was designed 
to stress the structure of English, with particular emphasis on the roles 
of syntax and inflection and on the meaning of function words. An induc- 
tive rather than a deductive teaching strategy was emphasized* Therefore, 
the course does not explicitly state ^rales' of English usage, but 
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presents items illustrating aspects of standard usage* Incidental learn- 
ing of basic sentence patterns is enhanced by presenting curriculum items 
in complete sentences. Fewer than one- tenth of the exercises present the 
student with single yords or isolated phrases. Incidental learning is 
also enhanced by requiring many constructed rather than multiple-choice 
responses. 

The course is not intended to be a complete course in English. 
Classroom instruction remains the largest portion of the student 
language experience, whereas the CAI course provides supplementary, 
individualized drill. On the other hand, the course is self-contained, 
and it supplies as many appropriate explanations and examples as possible. 
The classroom schedule of instruction need not be altered to adapt to the 
sequence of instruction in the CAI course, although paper-and-pencil 
drill given in the classroom can be reduced. No specific instruction 
in standard English usage is needed by students beginning the course. 
LeL^ons and Content 

The cairriculum is divided into 2ll+ lessons of 20-30 exercises each. 
These lessons include review tests that occur about once eveiy 12 lessons. 
It was designed to provide a student in the target population with enough 
10-minute daily sessions for an entire school year. An outline of the 
1972-73 version of the course is included as Appendix B. Separate topics 
are pr*^sented in separate lessons and there are several sequences of 
lessons on a single topic. The lessons are ordered to provide a cumu- 
lative basis of concep-tB building upon one another. Several lessons 
review topics presented in preceding lessons. 
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Although the content of the language arts course does not differ 
mailcedly from other language study courses for deaf students, its method 
is necessarily different* Its design includes: (a) consistency of format, 
(b) ixnambiguity of "correct" answers, (c) specific correction messages 
appropriate to incorrect responses, (d) internal data collection, (e) 
branching around blocks of material for more able students, and (f) inter- 
active student control* 

Fomats of instructions are consistent and unambiguous* The student 
is always allowed the options of having the problem repeated, frequently 
with a "help" message further clarifying the task, or of requesting the 
correct answer to nny problem* Instructions are as short as possible, 
and the nature of the task is the same throughout a lesson* 

Students taking the course may receive appropriate correction for 
particular wrong responses* For almost eveiy exercise throughout the 
course, careful attention •has been given to a variety of likely wrong 
answers* Short, but helpful messages, explaining the nature of the 
error, are returned immediately after particular wrong responses* An 
attempt is made at all times to reinforce any response that contains a 
part of the correct answer and to lead the student to the coaqplete 
correct answer* 

CAI differs from ordinary classroom instruction particularly in the 
ability to store complete response data* This ability qualifies it as 
a research tool as well as a teaching medium* Precise information on 
each student's response is stored for later analysis and revision of the 
course* Daily reports are written and may be ]J.sted by teachers and the 
IMSSS staff to monitor each student's progress and lesson scores* 
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If a lesson introduces a new topic, carefully sequenced explanation 
and instruction are given in a short "tutorial" section at the beginning 
of the lesson. In subsequent lessons on the same subject, short but 
complete instiructions are given. This tutorial instruction allows 
students to proceed through the course without waiting for group instixic- 
tion on each ne-4 topic. 

In all lessons except the review tests and the first introductory 
lesson, a student who demonstrates an ability to pericim the task required 
early in the lesson is automatically branched to the next lesson. This 
is accomplished by a checkpoint after 6-9 items, requiring 85^ correct 
responses on the first a::empt to execute the branch. In the "directions" 
lessons at the beginning of the coarse, scores are checked more frequently, 
allowing a student who has mastered the task by the middle of the lesson 
to bypass the rest. This branching allows a student who is proficient 
on one tcpic to branch ahead to a topic with which he may be less familiar. 

The order in which the lessons are given in Appendix B is the order 
in vhich most students take them. The lessons are interrelated in that 
concepts introduced in earlier lessons are used to explain concepts 
introduced in later lessons. However, lessons can be taken out of 
sequence. Eacn lesson is self-contained in that the task is completely 
explained and, except for the mixed drill lessons, each lesson focuses 
on a specifically defined task. A teacher can easily alter the order in 
which students encounter lessons to conform more closely with the 
development of classroom work, or to provide students with review 
le.isons on a specific topic. 
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Suggestions for the curriculum content came from many sources. One 
of the most important of these was the Kendalx School for the Deaf in 
Washington, D.C* Stanford and Kendall staff members worked together 
during the spring and summer of I97O to develop programmed lessons in 
English usage for sttrdents at the school. This was part of a larger 
Kendall plan to develop curriculum material in transformational grammar 
for deaf students. The content of the language arts course reflects 
this early cooperation, and the curriculum is oriented toward transfor- 
mational grammar, although more traditional approaches to teaching 
standard usage are also included* Many ideas were drawn from The Roberts 
English Series (Roberts, Ross, & Boyd, I97O), and the workbooks for the 
series furnished examples for specific items. 

Another valuable source of content suggestions was a group of re- 
search specialists in curriculum development for the deaf. The entire 
group met with the Stanford staff in the fall of 1970, and individual 
consultants have continued to make suggestions since that time. 

Teachers from the schools whose students used the course were 
encouraged to contribute ideas and criticism* In come cases, teachers • 
suggestions have resulted directly in a series of lessons. Comments on 
early lessons in the curriculum were incorporated in planning and writing 
later lessons and in revising the curricu^ m. 

Finally, samples of written work by students at Kendall School and 
California School for the Deaf at Berkeley were studied to indicate 
problem areas peculiar to deaf students. Results from a detailed study 
of the grammar and vocabulary of this early corpus were reported by 
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Fletcher^ Jamison, Searle, and Smith (1973), This study confimed some 
tentative conclusions that had guided the course structure and content. 

Terminology used in the language arts course reflects the blend of 
transformational and traditional approaches mentioned above. To some 
extent, it uses the terminology found in the Roberts • series through the 
fourth grade ♦ This terminology is not substantially different from that 
used in other curriculums reviewed liy the Stanford staff. Greater pre- 
cision is afforded by use of some Roberts* terms; e.g., the common term 
"auxiliary" is not used because understanding the function of elements 
commonly called auxiliaries in the phrases presented by the curriculum 
requires a set of more precise terms ^ so the Roberts' term "modal" is 
used to identify constituents such as can, may ^ vill . In addition to 
terms taken from other language curriculums, some labels were invented 
specifically for the language arts course to keep the terminology as 
short and clear as possible* Thus, for example, "ing-form" is used 
instead of "present participle," "have-word" for "foim of the verb have," 
"not-sentence" for "negative sentence." 
Interactive Student Control 

The language arts course is stinictured in a linear sequence of 
lessons* The program-selected ("automatic" order) lessons are shown in 
the course outline (Appendix B). Similarly, there exists for each 
problem a usual or "automatic" sequence of events; the exercise is 
printed, the student responds, the program prints an error message if 
he is incorrect, he eventually types the correct answer, and the program 
prints the next exercise. If the student exceeds his maximum number of 
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trials for an exercise, the program automatically prints the correct 
answer in a standard format before proceeding* 

Many students follow this standard sequence. However, the program 
also allows the student or his teacher or proctor to modify his inter- 
action with the curriculum in the following ways; 

1, CTRL-Z allows the student to terminate his session at any time. 
The program does not impose a time limit, so the length of student ses- 
sions may be determined by the school, the proctor, the teacher, or by 
the student himself. 

2. CTRL-A causes the program to reprint the instructions and the 
current exercise. Depending on the complexity of the exercise, a help^^ll 
message may also be printed. 

3* CTRL-G allows the student or teacher to specify a particular 
point in the curriculum for that student. This option may be used if 
the teacher wishes to use a sequence of lessons other than that listed 
in the outline and automatically presented by the program. It is useful 
for students who need instruction and practice in a specific subject 
area. 

U. CTRL-T causes the program to print the answer to the current 
exercise without waiting for the maximum number of trials. This option 
provides an immediate escape from an exercise that is too difficult for 
a given student. 

5. CTRL-H causes the program to skip the current exercise and to 
print the next exercise. It is useful to teachers who wish to review 
the lesson material quickly. 
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Thus the course can be quite flexible. If a school or teacher 
wishes to use the entire course as outlined, students can run the pro- 
gram virtually by themselves without the help of a teacher or proctor, 
especially by using the CTRL-A and CTRL-T options. If more specific 
instruction is desired, a minimum of effort is necessaiy to tailor the 
program's presentation to any student's needs. 
Objectives 

The course begins with 10 introductory lessons. The first lesson 
familiarizes the student with the teletypewriter, emphasizing such 
potential sources of confusion as the number "one" and the letter "I," 
and the number "zero" and the letter "0." The nine "directions" lessons 
that follow serve two purposes: (a) they provide material requested in 
early consultations by some teachers of deaf students, and (b) they 
familiarize the student further with the different kinds of instructions 
he will encounter later. These lessons are parallel to, but not as 
extensive as. The Language of Directions by Rush (1970). 

The specific objectives of the directions lessons are that students 

should be able to: 

1. Type any letter or letters in a given word identified by one 

of the following: ordinals ("first" through "fourth"), "after the first," 
"first two," "last," "before the last," "last two." 

2. Type any word or words in a given sentence identified by one 

of the following: ordinals ("first" through "fourth"), "after" or "before" 
a given word, "before the last." 

3. Copy a two- or three-word phrase from a given sentence, 
including spaces between words. 
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4* Given two or three rows of numbers (each row containing up to 
five numbers), type any n\amber whose position is specified by "above 
"below," or "under" another number* 

There are four general course objectives • Students are expected to: 

1. Recognize specified grammatical categories • 

2. Recognize and supply various forms of given grammatical structures 
3» Select appropriate graminatical units to complete a specified 

structure • 

k. PerfoOT specified transfonnations on grammatical structures* 
Under (l) of the general course objectives the following parts of 
speech and grammatical structures are explicitly identified: noun, 
determiner, noun phrase, verb, adjective, subject, predicate, pronoun, 
modal, vowel, preposition, prepositional phrase, and contraction* The 
student should be able to recognize the structure and identify the 
structure in a sentence* The specific tasks are: 

a* Identify one or more nouns, in either a nominative or an objec- 
tive position* 

b* Identify one or more of the following as determiners: "a," "an," 
"the," "some," "eveiy," "no," "all," cardinal numbers from "one" to 
"ten," and double dete miners with "all" or cardinals* 

c* Identify isolated vowels, and select from a group of words the 
one that starts with a vowel. 

d* Identify nominative and objective noun phrajses of the following 
types: single noun or pronoun, determiner-noun, determiner-adjective- 
noun, deteminer-determiner-noun, adjective-noun, determiner-adjective- 
adjective-noun* 
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e. Select from a given sentence one or more noiws specified as 
singular or plural. 

f. Identify verbs in the simple present, present progressive, 
simple past, past progressive, modal fom, or "be-word" fonii. 

g. Identify specifically verbs in the simple past tense. 

h. Identify as modals: "can," "could," "will," "would," "should," 
"may," "might," "must"; identify as "be-words": "am," "is," "are," "was, 
"were"; identify as "have-words": "have," "has," "had." 

i. Identify the complete simple or compound subject and the com- 
plete predicate of a given sentence. 

J. Identify as pronouns: "he," "she," "it," "they," "I," "you," 
"we," "me," "him," "her," "us," and "them"; and as possessive pronouns: 
"my," "his," "her," its," "your," "our," and "their." 

k. Given a declarative sentence and a related question, identify 
the nominative or objective noun phrase that answers the .question. 

1. Identify as prepositions: "in," "to," "of," "for," "with," "on 
"at," "by," "from," "after," "into," "over," and "before." 

m. Identify prepositional phrases of place and time of the forms: 
preposition-noun, preposition-determiner- noun, preposition-adjective- 
noun, preposition-detenniner-adjective-noun. 

n. Given a declarative sentence and a related question, identify 
the prepositional phrase that answers the question. 

o. Identify contractions of "be," "have," and "do." 

Under (2) of the general course objectives, the s+udent should be 
able to: 

a. Supply the plurals of given singular nouns, and the singulars 
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cf given plural ncunc* Beth regular and irregular plurals are used. 

b» Indicate whetner a specified noun phrase is singular or plural. 

c. Given the root forn» of a verb^ supply the gender marked form, 
simple past^ or present participle. Verbs given are regular (including 
those ending with single consonants and -y) and the irregular verbs 
"have," "go," and "do" in the third person singular and past foims. 

d. Indicate whether the subject cf a sentence is singular or plural. 

e. Given the gender marked form or the simple past form, supply 
the root fozra of the verb. 

Under (3) cf the general course objectives, the student should be 
able to: 

a. Type "a" or "an" before a given noun in a sentence, depending 
on the first letter of the noun. 

b* Choose from two given determiners the one that agrees in number 
with a given singular or plural noun in a sentence. 

c. Choose from two to seven given pronouns the one that is appro- 
priate either in auinber or gender or case or all three for the noun 
phrase that it will replace. 

d. Choose the correct inflection of a verb based on subject- verb 
agreement in number. 

e. Choose the correct inflection cf the present tense of "be" to 
complete a sentence. 

f . Given the root form of a verb, construct the connect form of 
the present progressive tc corr:plete a sentence, 

g. Choose the correct noun or pronoun to complete the subject of 
a sentence based on subjer.t-verb agreement in number. 
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h. Choose the correct preposition to complete a sentence. 
Under {k) of the general course objectives, the student should be 
able to: 

a. Combine two related sentences into one by specifying the 
position of an adjective to be inserted. 

b. Indicate the negative transforai of a given sentence (including 
a modal, a fom of "have," or a forai of "be") by specifying the position 
of "not." 

c. Construct a possessive noun phrase from a sentence of the form: 
noun phrase, form of "have," noun phrase. • 

d. Make a contraction of "be" and a pronoun or noun phrase. 

e. Expand a contraction of "be" from a given sentence. 

f. Make a negative contraction of "be," "have," or "do." 

g. Expand a negative contraction of "be," "have," or "do." 

h. Indicate the question transforai of a sentence by specifying 
the modal, have -word, or be-word that changes position. 

Reports 

• A daily report program makes available detailed information on 
student progress. The report gives information by IMSSS class number 
and is available both to teachers in the participating schools and to 
IMSSS staff. An example of a daily report 13 shown in Figure 1. The 
report heading documents the class number, teacher •s name, date of the 
report, number of students in the class (including those not flagged 
for the language arts course), name of the school, and class grade. The 
first number in the row of student information is the total number of 
lessons the student has completed to date. The number following that 
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CLASS 5U2 MR. RAPHAEL 10 APR 72 

9 STUDENTS — VICTORIA SCHOOL - HOUSTON — GRADE 5 

LANGU/CE A^S (G) REPORT 



57 ( 5) LESSONS kO/kl 
DAD 23/26 MAE 
DAF 3/ 7 DAG 

23 TOTAL LESSONS 
2 TOTAL LESSONS 



97% 19.1 MIN 
7/ 7 NPAC 
(CONT) 



283U JERRY HOHCINS 
7/ 8 DAI 7/ 



2837 MATT ARNOLD 
2950 BILL MORRIS 



Figure 1. Illustration of language arts 
curriculum daily report. 
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in parentheses is the number of lessons completed on that day. After 
the word LESSONS, the program prints the total score for the day (number 
of correct responses/number of completed problems) and converts the score 
to percentage correct. Tiie number of problems includes all problems 
completed on that day, not just the problems in the completed lessons. 
Following the percentage score is the total number of minutes the student 
has accumulated in the curriculum, a plus sign if the student used the 
course on the date of the report, the student's number and his name. On 
the second and following lines, the report lists the names of lessons 
the student completed on the day of the report, gi^^ng a score for each 
lesson (number of correct responses/number of completed problems). If 
the student stopped in the middle of a lesson, that lesson is listed 
but the score is not reported. Exercises completed in unfinished les- 
sons will be added to the daily totals reported on the first line. If 
the student has not taken a lesson on the date of the report, only his 
number, name, and total lessons completed will appear. 

Another report is available that gives for each student all the 
lessons completed to date by name and includes number of problems taken, 
percentage correct for each lesson, and an ordinal to indicate the order 
in which the lesson was taken. This report is not available 'on line' 
as is the daily report, but it is prepared and sent to teachers upon 
request. An example of this report is given in Figure 2. The report 
is generated by r,canning the stored student response data for a given 
class of students over a given period of time. The class number and 
period scanned are given in the heading. 
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CLASS kOl 
DAH 



VAC 
VAE 
MAH 
MPAF 



7 
28 
28 
21 



10-26-1971 THRU 12-17-1971 STUIffiST 460 JOYCE CAREY 

lOOfi MAF 7 

, „ lOojt TC 19 

57> AJAA 7 8516 AJAB 7 lOOjt AJAC 23 

77^t NPAE 25 

76jt MAK 



VAA 


7 


1009^ 


VAB 


7 


VAD 


7 


85^t 


MAG 


8 


AJAA 


7 


8516 


AJAfi 


7 


MAI 


27 


Trf> 


NPAD 


22 


AJAD 


20 




MAJ 


21 



CLASS 401 10-26-1971 THRU 12-17-1971 STUDENT 461 GULLY JIMPSON 
INTRO 28 8^ DIR 21 61^6 DIRS 7 lOOjt DIR3 



Figure 2. Exainple of the off-line language arts report for 
two students in class 4oi. The period scanned 
was October 26, I97I to December I7, I971. The 
entry for each lesson consists of lesson name, 
number of exercises completed in the lesson, 
and percentage correct. 
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Curriculum Revision 

Based on the analyses of items and lessons, the curriculum was re- 
vised during the summer of 1972 • Thirty-seven lessons were deleted from 
the 1971-72 version of the curriculum, k2 new lessons were added, and I3 
review tests were included, making a total of 2l8 lessons in the 1972-73 
version of the curriculm* 

The decision to revise or delete a lesson was usually based on the 
percentage of students who branched out of it at the first checkpoint* 
These percentages ranged from 1+1^ to 999(>; there were 28 lessons from 
which 95^ or more of the students branched out early* The amount of 
data was insufficient and, therefore, inconclusive for only three lessons 
and these occur at the veiy end of the course* This analysis revealed 
four general results that are not widely noted in the research literature 
on deaf education* 

First, the 'directions' lessons were far easier than anticipated, 
given the general impression among deaf educators that deaf students 
experience difficulty in following directions* Some reasons for this 
result may be that the directions in these lessons and in the curriculum 
were easier to follow than those given in classroom instruction, that 
the directions given in the language arts CM were more clearly communi- 
cated to students than the directions given in classroom instruction, or 
that deaf students have less difficulty following directions than generally 
supposed* More research is required to decide among these alternatives* 

Second, although pronouns were generally far easier than anticipated, 
items on possessive pronouns were extremely difficult for the students* 
Specifically, possessive pronouns that differed in number (his boxes, 
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their box) and/or gender (his sister, her husband) from the noxins they 

modified were seldom completed correctly. 

Third, copulas joining subjects with predicate complements that 

differed in number from their subjects were very difficult for the 

students. Copulas for items such as the following: 

The house (is, are) blue and white. 
The girls (seem, seems) lonely. 

were seldom completed correctly. 

Fourth, the students had very little trouble with contractions with 

the exception of 'I^m^, which was far more difficult for the students 

than anticipated. 

Many of the directions lessons were deleted. In all but two of the 
directions lessons <^ or more of the students branched out early. Most 
of the lessons asking for identification of letters were deleted because 
this task is seldom used in the course. Some directions lessons were 
kept because they cover several tasks in one lesson. 

The following lessons were added: 

3 lessons that provide practice with "who" and "what" questions; 

h lessons that require students to choose a correct pronouji to 
replace a nouin or no\ui phrase ; 

5 lessons that require students to choose a correct noun or pronoun 
based on subject-verb agreement in number; 

20 lessons that require students to identify and use correctly 
prepositions and prepositional phrases; 

1 lesson that provides practice with 'Vho," "what," "when," "where" 

questions ; 

2 lessons that require students to identify possessive nouji phrases 

3 lessons that provide practice using contractions ; 
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U lessons that provide practice with the question transformation. 

The review tests froni tha 197I-72 versions were deleted and replaced 
with review lessons that cover the revised contenc cf the curriculxwi. 
These tests occur approximately every twelfth lesson. 

THE LANGU.AGE ABTS TFST 
During the spring of I97I an extensi^^e search was made for a paper- 
and-pencil language test that would measure understanding of the language 
concepts covered in the language arts course. Few tests were found that 
were suitable for deaf students; none were suitable for tne CAI curriculum. 
The Full- Range Picture Vocabulary Test (Ammcns & Ammons, I9U8) and the 
Peabody Picture Vocabulary Test (Dunn, 1959) are both fairly widely used 
in schools for the deaf, but they test receptive rather than expressive 
language and emphasise word meaning rather than word usage. The Illinois 
Communication Scale (Withrow, I966) also tests I'eceptive rather than 
expressive language, and because it requires film, it is expensive and 
complicated to administer. Ths Language Test part of the Tests of Basic 
Exper i ences (Moss, I97O) also tests receptivie rather than expressive 
language; only about 30 itewi test word usage as opposed. to word meaning. 
Language Skills for Anericans (Stillwagon & Leake, 1952)., the Language 
Facility Test (Daily, I968), and the Language Usage Test developed at 
the Clarke School for the Deaf all test usage, punctuation, capitaliza- 
tion, and spelling. Only a small nui.iber of itema in these three tests 
cover topics in the CAI language-arts course and many of the "-items are 
too difficult for ths CAI student population. The Gates MacGintie 
Reading Tests (Gates & MacGintie, I965), the Lee - Clark Heading Test 
(l>ee & Clark, I958), Primary Reading Profiles (Stroud, Hieronymus, & 
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Mc5Kee, 1957), the Kansas Primary Reading Test (Schrammel, Hoag, Humble, 
Robinson, & Wlpf, 1935), and the Diagnostic Reading Test (I963) all test 
word recognition and reading comprehension rather than standard English 
usage. The language test developed at the California School for the Deaf 
at Berkeley (Marshall, I962), the tests developed as part of the language 
curriculum, Generating English Sentences (Stokoe, Goldberg, Covington, 
LaRue, Womeldorf, &. Bomsteln, I967), and the language tests developed 
at the Lexington School for the Deaf (Cooper, I965) all call for con- 
structed answers and provide no precise guidelines for correcting the 
test. The Picture Story Language Test (Myklebust, I965) covers many of 
the same aspects of usage that are covered in the language arts curriculum, 
but the complexity of scoring this test makes it impractical to administer 
to a large number of students. The Illinois Test of Psychollngulstic 
Ability (McCarthy Kirk, I963) Is used in several schools for tlie deaf 
and many teachers consider it a valuable diagnostic tool. Because it 
can only be administered individually, however, it was impractical for 
testing all of the students working on the CAI curriculum. The Stanfoixi 
Achievement Test (Keiley, Madden, Gardner, & Rudman, I966) and the 
Metropolita n Achievement Test (Durost, Blxler, Wrightstone, Prescott, 
& Balou, 1970) are being administered in many of the schools where the 
language arts cov.rse is being used. Again, however, these tests did not 
test the precise topics covered in the CAI coui'se- 

A set of tests were developed, therefore, to evaluate the language 
arts cnrilculum. Although tliere is a need for such tests in schools for 
the deaf, it was beyond the scope of the project to develop a broadly 
applicable language tei=t. ' Instead, a criterion test that measui'cs only 
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the objectives of the curriculum was written. The test items were modeled 
on the items in the course and were written for paper-and-pencil adminis- 
tration so that students who had not taken CAI could also take the test. 

A preliminary version containing JQ questions was developed in May, 
1971. This version was divided into eight subtests that covered the 
folJ owing topics: directions, parts of speech, noun phrases and double 
verbs, determiners, singular and plural noun forms, pronouns, subjects 
and predicates and adjective transforms. 

The 1971-72 version of the test covered most of the topics taught 
in the first 200 lessons of the course. The test had IO8 questions with 
one or two sample questions for each of I5 subtests. 

Based on test and curriculum performance data gathered in I97I-72 
and on the curriculum revision for 1972-73, the language arts test (LAT) 
was revised in the summer of 1972. The current version of the LAT pro- 
vides eight questions on each of the I6 subtests listed in Table 2. 

Three parallel forms of the LAT were constructed. The sample 
questions are identical on all foms and the items for each subtest are 
parallel in that three items for each morpheme position in the test are 
generated under fairly rigid syntactic and conceptual constraints and 
then assigned at random to the three subtest forms. 

Specific directions for administering the LAT were written and 
include the correct answer to each sample question and set a time limit 
of 5 minutes for each rmbtest. 

EVALUATIOI! EXPERIMENT 

In evaluating the language artt; curriculum we emphasized variation 
in intensity of experimental treatment rather than simple comparisons of 

25 



Table 2 



Subtests of Language Arts Test 


Subtest 


Title 




1 


Directions 




2 


Identifica-^ion of nouns and pronouns 




3 


Identification of adjectives, determiners 


and 




possessive pronouns 




k 


Identification of verbs 




5 


Identification of noun phrases 




6 


Choose the correct deteiminer 




7 


Choose the correct form of the noun 




8 


Choose the correct pronoun 




9 


Choose the correct form of the verb 




10 


Choose the correct preposition 




11 


Identification of phrases that answer the 


question 


12 


Write singular and plural forms of nouns 




13 


Wilte forms of verbs 




Ik 


Make and expand contractions 




15 


Negative and adjective transforms 




16 


Possessive and question transforms 
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experimental and control groups- The puipose of the experiment was to 
measure the effect of va.rying number of language arto sessions on post- 
test jcorei.'. Each student was allowed to tal:e only a specified number 
of 10-minute language arts sessions depending on which of five experi- 
mental groups he was assigned tOo A student who signed on to the 
mathematics strands curriculum and who had not received sufficient 
language arts sessions, which depended on his experimental group and 
the number of school days in the experiment, was automatically given a 
language arts session. Analogously^ a student who signed on to the 
language arts curriculum and wno had received sufficient language arts 
sessions already vas automatically given a mathematics strands session* 

Data from the experiment were analyzed in two ways: first, in the 
context of traditional ana3-ysis of variance, and second, in the context 
of five models that attempted to account for posttreatment achievement 
in tenns of pretreatment achievement and number of language arts sessions 
taken. Pre- and posttreatment achievement was measured by the language 
arts test described above and by standard tests, ana the relationship 
of perforaance on the language arts test, with perfonriance on standard 
tests v;as estimated. Tlie language-arts evaluation experiment was 
analogous in method and presentation to the mathematics strands evalu- 
ation experiment reported by Suppes, Fletcher, Zanotti , Lorton, and 
Searle (1973)* 
Models of Student Progress 

Five models of student perfonuance were used to characterize the 
relationship of posttreatment scores to px^^et treatment scores and mamber 
of language art:, sessions taken. In all of those models T^^ denotes 
the pretreatment score of student i^ T^,, denotes the posttreatment score 
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of student i, and denotes number of language arts sessions taken by 
student i. Following standard notation is the expected post- 

treatment score of student i. 
Model I, Linear* 

In this model, the effect of pretreatment score and number of 
sessions on posttreatment performance is assumed to be linear* 
Model II, Linear with interaction* 

In Model II, a linear effect of pretreatment score and number of 
sessions is assumed, but a linear effect from the interaction of pre- 
treatment score ani number of sessions is also postulated. 

Model III, Cobb- Douglas. 

E{£n T^^) = ^0 ^1 '^il ^2 ^i * 

Model III is based on a formulation of the Cobb-Douglas type (from 
econometrics), namely, 

This model is multiplicative and assumes "weighted interaction" in that 
a^ and a^ indicate the relative importance of pretreatment score and 
number of sessions, respectively, in accounting for charige in post- 
treatment scores. 

Model IV, Log quadratic. 

^^'^i2^ " ^0 Vil ^2 ^i ^3^'^'' ^i^^ ^i^'^ 
In Model IV, the effect of the pretreatment score is assumed to be 

28 



linear, but the effect of number of sessions is assiomed to be logarithmic, 
rather than linear. In order to explore this logarithmic assumption 
fully, second- and third-order terms in in are included. 
Model V, Exponential. 

E(in T.g) = + a^N^T^^^ . 

Model V is based on an exponential formulation, namely. 

In this model, the effect of number of sessions and pretreatment score 
may be strictly increasing or strictly decreasing depending on the sign 
of a^^. Pretreatment score and number of sessions are assumed to interact. 
Subjects 

As many students as possible from among those who were taking both 
the language arts and the mathematics strands CAI courses in 1972-73 s^nd 
who were attending a residential school for the deaf in California, 
Oklahoma, or Texas were selected to participate as subjects in this 
experiment. The degree of hearing loss among the subjects selected for 
the experiment was essentially that adopted for admission standards by 
the schools. Generally, this loss averages at least 60 decibels in the 
better ear. Students who were enrol?.ed for both language arts and 
mathematics strands CAI were usually of average or above-average ability 
relative to their school population* 
Procedure 

Of the 230 students selected as subjects for this experiment 
were randomly assigned to Group I, ii6 were randomly assigned to Group II, 
46 to Group III, ii7 to Group IV, and h(> to Group V* Random assignment 
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of the subjects to the treatment groups was stratified so that roughly 
the same number of subjects from each school were assigned to each of 
the five treatment groups • 

Students assigned to Groups I, 11^ III, IV, and V were peimitted 
20, 45, 70, 95, and 120 language arts sessions* The maximum of 120 
sessions was chosen by assvuning that all students in the experiment were 
assigned two sessions per day, one for language arts and one for mathe- 
matics strands, that there were 80 school days in the experimental period, 
and that the probability of any student's actually taking an assigned 
session was •SO. These assumptions yielded an estimated maximum of 128 
sessions which was rounded down to 120 • 

Ordinarily, language arts sessions are terminated by students* 
request* The design of the present experiment required fixed, or at 
least deterministic, session lengths • For this reason all students in 
the experiment received 10-minute language arts sessions • A student 
participating in the experiment had no control over the type of session, 
mathematics strands or language arts, he received. Whether he signed on 
for strands or language arts, he was given a language arts session if 
he was eligible for one* Otherwise, he received a mathematics strands 
session* 

Assignment of the required number of language arts sessions was 
spread across the experimental period in accordance with the following 
algorithm: 



if 




was true, then student i received a language arts session, otherwise, he 
received a mathematics strands session* In the algorithm, 
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NS^ = number of language arts sessions taken during the experi- 
mental period by student i , 

TS. - total number of language arts sessions student i was to 
receive during the experimental period, 

TD^ = number of school days in the experimental period for 
student i, 

= number of school days student i has been in the 
experimental period, 

and the brackets denote the next greatest integer. 

The nximber of language arts sessions a student received was monitored 
daily. Teachers and proctors were encouraged to help students achieve 
the number of language arts sessions they were assigned. Teachers were 
urged not to give compensatory off-line work to students who were assigned 
low numbers of on-line sessions, and, in general, not to alter the class- 
room woric of any student because of his participation in the experiment. 

Subjects in the experiment were tested just before the experiment 
began and Just after the experiment ended. Two of the three parallel 
forms of the IMSSS language-arts test were used for these test adminis- 
trations. Also, end-of-year SAT scores for the Paragraph Meaning and 
Language subtests were obtained for as many of the subjects as possible. 
As a standard operating procedure, all three participating schools 
administered the SAT to all students enrolled at the end of each school 
year. 

Analysis of Variance Results 

Complete pre- and posttreatment data were obtained on the language 
arts test for 197 of the subjects in the experiment. However, many of 
these subjects had received sessions during the 19^1-72 school year, 
and it was decided to limit the data analysis for the language-arts 
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evaluation experiment to the 85 subjects who had finished 26 or fewer 
sessions in 1971«72. A student who finished 26 or fewer sessions in the 
1971-72 version of the language arts course would have received only 
directions lessons during that year and no CAI in the portions of the 
course that were directly relevant to standard English usage. This 
procedure yielded 21 subjects in experimental Group I, Ik subjects in 
Group II, 11 subjects in Group III, I8 subjects in Group IV, and 21 
subjects in Group V. Means and standard deviations for number of sessions 
taken by subjects in the five groups are shown in Table 3. The averages 
for sessions taken are low for Group IV and Group V; however, the integ- 
rity of the experimental design was sufficiently maintained and the 
treatment groups sufficiently distinct to warrant proceeding with analysis 
of variance. 

As a chpck on the random assignment of subjects to treatments, an 
analysis of variance was performed taking pretreatment LAT scores as 
dependent variables. The results of this analysis, with the average 
pretreatment LAT scores for each treatment group are shown in Table k. 
As the table shows, the assignment of subjects to treatments was random 
with respect to subjects* pretreatment scores despite almost an 11-point 
difference in favor of Group I average scores over Group V average scores. 

Analysis of variance taking the posttreatment LAT scores as dependent 
variables was performed at the end of the experiment. The results of 
this analysis with the average posttreatment LAT scores for the five 
treatment groups are shown in Table 5* These results were not statis- 
tically significant, and it was concluded that there is no functional 
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Table 3 

Obtained Nxunber of Studeats and Sessions for the 
Five Treatment Groups In the Experiment 



Number of Number of Average nvunber 

Treatment stvidents sessions of sessions Standard deviation 

group obtained assigned obtained of sessions obtained 

I 21 20 22.05 .9T 

II Ik k5 ^6.21 1.12 

III 11 70 68.91 2.26 

IV 18 95 90.11 8.52 

V 21 120 109. 21* 17.88 
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Table k 

Analysis of Variance for Pretreatment LAT Scores 
for the Five Treatment Groups 



Treatment group 





I 


II 


in 


IV 


V 


Sample size 


21 


Ik 


n 


IS 


21 


Mean 


73.95 


61.86 


60.U5 


56.33 


63.05 


Standard deviation 


28.27 


26.1*6 


29.52 


28.82 


33.78 



.Analysis of variance 





SxuD of squares 


df 


Mean square 


F ratio 


Betveen groups 


3355.81t 


U 


838.96 


.9>*9» 


Within groups 


70758.3^+ 


80 


881t.U8 




Total 


7ltlllt.l9 


8U 







♦Nonsignificant; F no«:(^^80) = .12 and F ^^C+^SO) = 3.OI. 



ERIC 



3^ 



Table 5 

Analysis of Variance for Posttreatment LAT Scores 
for the Five Treatment Groups 



Treatment group 





I 


II 


III 


IV 


V 


Sample size 


21 


Ik 


11 


18 


21 


Mean 


86.29 


82.00 


71.^5 


73.^+^+ 


79.67 


Standard deviation 


26.37 


2U.08 


31.13 


28.71 


31.UI 



Analysis of variance 





Stun of squares 


df 


Mean square 


F ratio 


Between groups 


21+23.92 


h 


605.96 


.71+7* 


Within groups 


61+888. 13 


80 


811.10 




Total 


67312.05 


81+ 







♦Nonsignificant; F,o25^^'^°^ '"^ ^.975^^'^°^ ^ 3.01. 
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relationship between achievement tested by the LAT and number of language 
arts CAI sessions taken, at least with respect to the analysis of variance 
model used# 

The null result could be explained by lack of reliability and/or 
validity in the LAT* An indication of the reliability of the LAT is 
given by the correlation of pre- and posttreatment scores in the 85- 
subject sample • This correlation was •91 with a standard error estimate 
(see) of 11, 80 and an F ratio for significance of the regression of 
400*78 (F oJ1,83) = 7*08)* Although a full-scale reliability study of 
the LAT is beyond the scope of this investigation, these pre- and post- 
treatment regression results indicate that the LAT is probably more 
reliable than many published tests • 

Three regressions were examined for an indication of the content 
validity of the LAT# Scores on the LAT taken as independent variables 
were regressed onto number of lessons completed by the 85 students and 
against the SAT Paragraph Meaning and Language subtest scores of 62 
subjects for whom these scores were available • Results of these regres- 
sions are shown in Table 6# 

Achievement on a valid test for the language arts curricultim should 
be related to achievement in the curriculum, and this apjpears to be true 
for the LAT as evidenced by the significantly high correlation of •60 
between lessons completed and LAT scores • The LAT evidently has some 
validity as a measure of achievement in the language arts course • 

The SAT Paragraph Meaning subtest emphasizes the comprehension of 
connected discourse (Kelley, Madden, Gardener, Sc Rudman, I966), and it 
is more characteristic of standard reading tests than of language arts 
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Table 6 



LAT Scores Compared with Lessons Completed 
?uid SAT Subtest GP Scores 



Dependent variables 


Language arts 
correlation 


standard error 
of estimate 


F-ratlo 


N 


Lessons completed 


.60 


53.1*9 


k6»20** 


85 


SAT Paragraph 
Meaning 


.21 


.95 


2.72 


62 


SAT Language 


.73 


.65 


68.82** 


62 



**Slgnlflcant at p < .01; F qq(1,83) a 7.08j F qo(1,60) - 7.08. 
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tests. Scores on a valid test of the language arts curriculum therefore 
should not necessarily correlate significantly with scores on the SAO' 
Paragraph Meaning subtest, which is apparency true given the observed, 
nonsignificant correlation of .21 between LAT and Paragraph Meaning scores. 

The SAT Language subtest comprises items on standard English usage, 
punctuation, capitalization, dictionary skills, and sentence sense 
(Kelley, et al., I966). These items are characteristic of language arts 
tests ^ and scores on a valid test of the language arts curriculum should, 
therefore, correlate significantly with scores on the SAT Language sub- 
test. This appears to be true given the observed, significant correlation 
of .73 between LAT and Language scores. 

The data indicate that the LAT is reliable and a valid test of 
achievement for the language arts curriculum. However, the correlation 
between the LAT and the SAT Paragraph Meaning subtest was greater than 
the correlation between the LAT and the number of language- arts CAI 
lessons completed. In some sense* then, the LAT may be "more valid" as 
a test of general language-arts knowledge than of achievement in the 
language arts curriculum. 

As a final effort t > find a functional relation between language 
arts sessions taken and a measure of achievement, analysis of variance 
was performed using the five treatment groups and taking the SAT Language 
GP scores as dependent variables. Results from this analysis are shown 
in Table 7. The F-ratio is significant at p < .05. Because the F-ratio 
is smaller than chance, however, a reasonable interpretation of the data 
is that the results are due to a violation of the analysis of variance 
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Table 7 

Analysis of Variance for Posttreatment SAT Language 
GP for the Five Treatment Groups 



Treatment group 





I 


II 


III 


IV 


V 


Sample size 


15 


10 


8 


8 


16 


Ifean 




3.65 


3.51 


3.51 


3.71 


Standard deviation 


.79 


.71 


1.01 


.63 


1.38 



Analysis of variance 





Sum of squares 


df 


Mean squai« 


F ratio 


Between groups 


,kk9 


k 


.112 


.119* 


Within groups 


53.816 


57 






Total 




61 







♦Significant (p < .05); F (1|,57) = 3.13 and (1|,57) = .12. 
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assumption rather than to an effect due to the treatment groups. In this 
case, the assumption of homos cedasticity was violated and the treatment 
group variances differ significantly. 

An analysis of variance was performed on posttreatment SAT Paragraph 
Meaning GP scores. The results of this analysis are shown in Table 8. 
No significant effects on the Paragraph Meaning GP scores due to the five 
treatment groups were evident. 
Performance Models Results 

Parameters were generated for the five models described above taking, 
first, LAT posttreatment scores and, second, SAT Language subtest scores 
as dependent variables. Because the number of lessons completed by the 
students correlated significantly with LAT and Language scores, an addi- 
tional model, Model VI, was added: 

E{T^) = + a.T^ + a^N + a^L , 

where T^^, T^, and N are defined as before and L is the n\imber of lessons 
completed. Presiimably, the better students both completed more lessons 
and scored higher on the LAT and Language tests. However, if the a^ 
sessions parameter contributes significantly to Model VI after the con- 
tributions from the pretreatment LAT scores and number of lessons 
completed have been included in the model, then it is reasonable to 
conclude that there is at least some effect on the dependent variables 
from number of sessions taken* 

The models with their generated parameters are shown in Tables 9 
and 10. Table 9 shows the models fitted to LAT scores taken as dependent 
variables, and Table 10 shows the models fitted to SAT Language GP scores 



ho 



Table 8 

Analysis of Varlemce for Posttreatment SAT Paragraph 
Meaning GP for the Five Treatment Groups 



Treatment group 





I 


II 


III 


IV 


V 


Sample size 


15 


10 


8 


13 


16 


Mean 


4.12 


3.71 


4.25 


4.17 


4.43 


Standard deviation 


1.13 


.99 


.72 


.88 


.97 



Analysis of variance 





Sum of squares 
• 


df 


Mean square 


F ratio 


Between groups 


3.292 


4 


.823 


.875* 


Within groups 


53.635 


57 


.941 




Total 


56.927 


61 







♦Nonsignificant; F^^^(4,57) = 3.13 and (4,57) = .12. 
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Table 9 

Six Models of Student Perfonnance with LAT 
Scores as Dependent Variables 



Model I ; Eil^) = + a^T^ + a^N 

= 23.975, a^^ = .867, ag = .000* 
Multiple correlation = .910 
Model li t E(T2) = a^ + a^T^ + agN + a^T^N 

^0 = 25. 427, a^ = ,Qkk, ag = -.020,* a^ = .000* 
Multiple correlation =: .910 
Model III ; E(in Tg) = ®1 ^1 + ^2 ^ 
a^ = 2.161, a^ = .5I16, ag = -.014* 
Multiple correlation = .800 
Model IV; E(Tg) = a^ + a^T^ + ag(in N) = a^Cin N)^ + a^(in N)^ 

aQ = -35.81*1, = .871, ag = 30.815,* a^ = -3.885,* a,^ = .000* 
Multiple correlatioi .911 
Model V ; E(in Tg) = a^ + a^T^N 
a^ = 4.040, a^ = .0001 
Multiple correlation = .476 
Model VI ; E(Tg) = a^ + a^T^ + agN + a^L 

= 30.916, a^ - .684, ag = -.l40, a^ = .125 
Multiple correlation = .927 
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Table 9 (cont'd) 

Note:"T^ = pretreatment LAT 
Tg = posttrcatment LAT 
N = number of sessions 
L = number of lessons. 

*Does not contribute significantly to the model. 



Table 10 

Six Models of Student Perfoimance with SAT Language 
Subtest Scores as Dependent Variables 



Model I ; EiT^) = a^ + a^^T^^ + bl^H 

a^ = I.5U9, a^ = .030, a^ = .001* 
Multiple correlation = ,806 
Model II ; E^l!^) = a^ + a^T^^ + bl^H + a^T^^N 

a^ = 1.370, a^ = .032, a^ = .003,* = .000* 
Multiple correlation = .80? 
Model III ; E(Jn T^) = a^ + a^ in T^^ + a^ in N 
a^ = -.772, a^ = .U65, a^ = .000* 
Multiple correlation = .79I 
Model IV ; E{T^) = + a^T^ + a^ (in N) + a^ (in N)^ + aj^ (in N)^ 

a^ = -I.U06, = .030, a^ = I.516,* a^ = -.186,* aj^ = .000* 
Multiple correlation = .809 
Model V ; E(in T^) = a^ + a^T^^N 
a^ = 1.081, a^ = .OOOU 
Multiple correlation = .U70 
Model VI: E(T2) = + a^T^^ + a^H + a^L 

a^ = 1.608, a^^ = .028, a^ = -.0003,* a^ = .001* 
Multiple correlation - .807 
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Table 10 (cont^d) 



Note:— = pretreatment SAT Language GP 
Tg = posttreatment SAT Language GP 
N s nvunber of sessions 
L = number of lessons. 

♦Does not contribute significantly to the model. 
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taken as dependent variables. The best model of student perfoimance in 
Table 9 is Model VI, which accounts for 86^ of the LAT score variance 
and which is a "straightforward" linear model in that it includes no 
interaction, exponential, or logarithmic tenns. It should be noted, 
first, that the regression coefficient for number of sessions taken 
contributes significantly to Model VI and, second, that the coefficient 
is negative. Evidently, for all levels of pre treatment achievement 
measured by the LAT, nmnber of sessions taken enters the model as a 
"rate" variable; the fewer sessions a student needs to complete a given 
number of lessons, the higher his LAT posttreatment score. Because the 
regression coefficient for number of lessons completed does contribute 
significantly to Model VI, which also takes into account LAT pretreatment 
scores, it is reasonable to conclude that a student who is required to 
complete more lessons, rather than more sessions, will, as a result, 
score higher on the posttreatment LAT. 

All the dependent variable variance accounted for by the models in 
Table 10 appears to be due to the simple linear relationship between 
pretreatment LAT and the SAT Language subtest. In Model VI it should 
be noted that number of lessons completed does not contribute signifi- 
cantly to SAT Language score variance after the contribution of pre- 
treatment LAT scores is included in the model. This finding obtains 
from the analysis despite the significant correlation of lessons 
completed with Language scores when pretreatment LAT scores are taken 
into account. 

Finally, it is notable that the correlation between pretreatment 
LAT scores and the SAT Language GP scores is greater than the correlation 
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between posttreatment LAT scores and Language GP scores. The pretreatment 
LAT accounted for 66^ of the variance in Language GP scores compared with 
53^ for the posttreatment LAT. It is difficult to explain this result. 
However, because of the significant correlation between number of lessons 
completed and the language scores, it is not reasonable to conclude that 
the language arts curriculum had a deleterious effect o ; the Language GP 
scores. 

TEACHING STRATEGIES EXPERIMENTS 
Three issues that commonly arise in the design of tutorial CAI 
curriculum are the following: the utility of providing "tailored" wrong 
answer messages in response to specific, anticipated wrong answers com- 
pared with a simple statement such as NO or WRONG in response to all 
wrong answers; the utility of providing for second and third guesses 
after a student initially responds incorrectly to an item compared with 
only one consecutive trial per item; the utility of requiring a student 
to respond correctly after he has made an incorrect response to an item 
and has been told the correct answer. Accordingly, three experiments 
were run in 1972-73 in the context of the language arts curriculum in an 
attempt to resolve these three issues. 
Subjects 

All CAI language arts students in three residential schools and five 
day schools for the deaf participated in the three experiments. The 
students were not aware of their assignment to the three experiments. 
Characteristics of these students were essentially the same as the 
characteristics of the students who participated in the evaluation ex- 
periment described earlier. In general, deaf day school students are 
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slightly further behind school norms than the deaf residential school 
students, but there was no evidence that the particular students chosen 
as subjects in these experiments were of either lower or higher ability 
than students who participated in the evaluation experiment. Also, in 
accord with the procedure followed for the evaluation experiment, data 
from students wh»^ received more than 26 lessons in I97O-7I and/or I97I-72 
were excluded* Complete data were obtained for I38 students who then 
comprised the subject population for these three experiments. 
Procedure 

Each student who participated as a subject was assigned independently 
and at random to one of two groups in each of three experiments. These 
assignments were made automatically by computer program when a subject 
began the language arts curriculum. Pretreatment and posttreatment LAT 
scores were recorded for each subject in the experiments* 

Experiment 1 comprised two treatment groups. One group received 
programmed correction messages that were tailored for specific, antici- 
pated wrong answers. About half of the exercises iri the curriculum 
include one or more of these programmed correction messages. Members of 
the second group in Experiment 1 did not receive these messages; they 
were told only that their answer was WRONG. In accordance with their 
Experiment 2 treatment group, both Experiment 1 groups received the 
correct answer after the wrong answer response was given. 

Experiment 2 comprised two treatment groups. One group was allowed 
three trials per exercise, the second group was allowed only one trial 
per exercise. The members of the first Experiment 2 group received 
either a programmed correction or a WRONG, depending on their Experiment 1 



treatment group, after the first and second trials on an exercise. They 
were not given the correct answer explicitly until the third trial unless 
the correct answer was part of a programmed correction message. The 
correct answer was rarely included in these correction messages. 

Expei^ment 3 comprised two treatment groups. In one group, the 
correct answer was given explicitly, but students were .not required to 
type the correct answer after it was given. In the second group, members 
were required to type the correct answer after it was explicitly given 
following a wrong response. 

The two groups under each of the three experiments yielded ei«ht 
possible treatments for any given member of the I38 student population. 
The experimental treatments and the number of students randomly assigned 
by the computer program to them are summarized by Table 11. 
Results and Discussion 

The LAT was administered at the beginn;.i;g of the 1972-73 school 
year and at the end of the school year to all students in schools for 
the deaf who took the language arts CAI curriculum. Care was taken to 
assure that each subject received two different fonns of the LAT on these 
two test administrations. 

Results from the pretreatment LAT administration for subjects in 
each of the two treatment groups in each of the three teaching strategies 
experiments are shown in Table 12. Because of the large differences 
between the mean LAT pretreatment scores of each pair of treatments, 
analysis of covariance was used in examining the posttreatment LAT scores. 
Results from the posttreatment adminiotratlon of the LAT adjusted for the 
pretreatment LAT which was used as a covariate are shown in Table I3. 
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Experiment 1 . As Table 13 shows, there was no practical or signifi- 
cant difference in LAT achievement between subjects who received tailored 
wrong answer messages and those who received standard wrong answer mes- 
sages. Considerable time and concomitant expense are ordinarily allocated 
to constructing tailored wrong answer messages for tutorial CAI. This 
was certainly the case for the language arts curriculum. A check of the 
most frequently given wrong answers revealed that the wrong answer 
messages written for the language arts curriculum were generally appro- 
priate. The subjective impression of the authors was that revising the 
set of tailored wrong answer messages used would not significantly affect 
the Experiment 1 results. 

Experiment 2 > Posttreatment LAT scores revealed significantly 
superior results for the three-trial treatment group over the one-trial 
treatment group • Evidently the opportunity to try again provided 
significant benefits for students taking the language arts curriculm. 
This result seems to support a hypothesis«gene ration theory of learning. 
Under such a tht'ory, a subject who is told that an answer he gave was 
wrong receives very little information; it is far more informative to 
him to receive positive corroboration of a hypothesis that he has 
generated. 

Experiment 3 . Posttreauuent LAT scores indicated a positive, 
significant effect from requiring subjects to i^spond correctly after 
making a wrong answor and being told the correct answer. This result 
is intuitively reasonable, because a subject who is responding rapidly 
in the typical context of CAI might easily ignore answers that fail to 
accord with his understanding. For that matter, the Experiirent 3 
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results imply that subjects who were not required to respond correctly 
before continuing past a problem, for whatever reason, ignored some of 
the corrcict responses. 

ITEM ANALYSIS 

The intent of this analysis was to identify usel^al dimensions of 
difficulty that affect performance on language arts items taken by deaf 
students • Three different item classifications were used* Items were 
classified by the specific course objectives listed earlier, by the 
required exercise tasks, and by the required fomats for correct answers. 
Subjects 

The responses of 31 hearing-impaired students, Ik boys and 17 girls, 
who completed no language arts lessons in 1970-71> fewer than 27 lessons 
in 1971-72, and at least I5O lessons in I972-73, were selected for the 
item analysis of the 1972-73 language arts curriculiun* Only the initial 
responses of each subject to each item were considered in the analysis* 
The agfis of the subjects ranged from 12 years 6 months to I9 years 5 
months with an average age of I6 years 3 months* All but one of the 
subjects were selected from I'esidential schools for the deaf* The 
characteri.stics of these subjects were the same as those of subjects 
selected for the /^ve^luation and teaching strategies experiments. Hearing 
loss of each subject averaged at least 60 decibels in the better ear. 

The language-arts curriculum responses of 12 heailng, American 
Indian students, thi^e boyiL^ and nine girls, were arialyzed in a parallel 
investigation. These studentf.^ attended a Bureau of Indian Affairs (BIA) 
school on a reservation in Mev/ Mexico. It is difficult to characterize 
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American Indian students other than to note that they are generally ill 
equipped to cope with the values and content of middle- class Anglo 
education. Many of these students speak an Indian language in their 
homes, and many have adopted the rich culture of their tribe long before 
entering a BIA school. They typically score below grade level on most 
standardized tests of academic achievement. The ages of the Indian 
students ranged from 9 years 11 months to 13 years 3 months with an 
average age of 11 years 3 months. All the Indian subjects completed no 
language arts lessons in 1970-71, fewer than 27 lessons in 1971-72, and 
more than I50 lessons in 1972-73 . Again, only the initial responses of 
each subject to each item were considered in the analysis. 
Results 

Course objectives . Because all subjects had finished only I5O of 
the 218 lessons in the curricula, only 28 of the h2 specific objectives 
listed earlier were included in the analysis. Notably, none of the 
specific objectives under the fourth general course objective — perform- 
ing specified transformationr. on grammatical structures— -could be included 
in the analysis. The objectives are listed in abbreviated form in Table 
Ih. Table II+ also lists the number of items included under each objective 
and, for deaf and Indian subjects, the difficulty ranking (Rank) and the 
proportion of correct answers for each objective (PCA). Kendall^s rank 
coefficient was calculated for the difficulty rankings cf the objectives 
in the two sets of data. This statistic indicated that the two difficulty 
rankjags were independent (r .16, S ^ 60,. N - 28). 

The relative difficulties of the general course objectives concerned 
with directions, grammatical categoriec^, grammatical structures, and 
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Table Ik 



Numbe- of Items (N), Difficulty Ranking (Rank), and Percentage 
of Correct Answers (PCA) for 28 Specific Objectives 



Deaf Subjects Indian Subjects 





Objective 


N , 


Rank 


PCA 


Rank 


PCA 


la 


TVpe specified letters 


20 


2k 


.801 


9 


.936 








T7 


»o*+p 


7 




Ic 


Copy specified phrase 


5 


2 


.908 


23 


.86U 


Id 


Type specified number 


15 


26 


.79^ 


3 


.970 




xaeuoxiy nuiuxncixivc or 
objective nouns 


j7 




.012 


20 


.ool 


Ph 
^ u 


XUCUOllj UUUii pXiXxiDCD 


IX 




.033 


£1 


.070 






OH 




.030 


ill 


.9ID 


2d 


Identify vowels 


12 


13 


.860 


10 


.928 


2e 


Identify nominative and 
objective noun phrases 


77 


27 


.755 


27 


•77^* 


2f 


Identify singular and 
plural nouns 


17 


28 


.650 


28 


.76U 


2g 


Identify tense mariced 
verbs 


59 


7 


.889 


26 


.795 


2J 


Identify naninative and 
predicate adjectives 


35 


25 


.798 


25 


.8U2 


2k 


Identify subjects and 
predicates 


72 


10 


.872 


2k 


.853 


21 


Identify pronouns 


35 


19 


.837 


12 


.918 


2m 


Identify answering 
noun phrases 


70 


16 


.851 


17 


.910 


2n 


Identify prepositions 


20 


8 


Mk' 


13 


.917 



Table Ik (contM) 



Deaf Subjects Indian Subjects 

N Rank PCA Rank PCA 

20 Identify prepositional 77 5 ^899 I9 •893 

phrases 

3a Supply plural and 7I 15 ♦852 18 ♦898 

singular nouns 

3b Indicate singular and 76 3 ♦908 11 .921 

plural noun phrases 

3c Supply gender marked 63 k .905 8 .939 

verbs 

3d Indicate singular and U7 11 .865 22 .872 

plural subjects 

Ua Supply "a" or "an" 23 Ik .858 I6 .9IO 

Ub Choose determiner for kk 18 .837 15 •913 
number 

Uc Choose pronoun to replace 99 9 •880 5 .951 

noun phrase 

ki Choose verb inflection IU7 12 .862 6 .9U5 

for number 

Ue Choose inflection of kl " 1 •978 

"to be" 

kg Choose noun and pronoim 59 22 .833 k .957 

for number 

Uh Choose preposition 39 6 .890 2 .975 
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grammatical units were investigated by categorizing each specific objec- 
tive under one of these general objectives and by calculating the Kruskall- 
Wallis multisample test statistics^ H, for the four sets of difficulty 
rankings. Results from this analysis for bQth deaf and Indian subjects 
are shown in Table I5. The four general objectives were significantly 
related to the item difficulty rankings for the Indian students (p < .05) > 
but not for the deaf students* 
Exercise Tasks 

There were four dimensions of classification by exercise task* 

I. InstiTictions given or no instructions given. This dimension 
distinguished exercises that occur early in lessons for which the in- 
structions are printed or repeated, from exercises that occur later in 
lessons when it was assumed the student had them well in mind* 

2* Instance (number) or instance (text) or concept. This dimension 
distinguished exercises in which the student must answer with an instance 
of a concept from exercises in which the student must answer with a 
concept based on a given instance. When concepts are answers they are 
always abbreviated. Some instances are numbered so the student can reply 
with number(s) associated with the text--instance (number) --rather than 
with the actual text of the instances — instance (text). 

3. Recognition or constioiction (explicit basis) or construction 
(implicit basis)* This dimension distinguished exercices in which the 
answer is printed in the exercise display— recogniticn--from exercises 
in which the answer does not appear in the dii3play--constraction. The 
cons tiiict ion (explicit basis) and construction (imr licit basis) dimen- 
sions distinguished between degrees, of explicitnesr. in the exercise 
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directions* In construction (explicit basis) a fora, but not the correct 
fom, of the correct answer text is given; in construction (implicit 
basis) no form of the correct answer is given explicitly. 

hp Usage or definition* This dimension distinguished exercises in 
which the answer is derived on the basis of an implicit rule of usage 
taught inductively in the curriculum from exercises in which the answer 
is derived from the definition of a grammatical category* 

Given 2 times 3 times 3 times 2 possibilities, there would be 36 
categories under this task classification scheme if it were not for the 
following combinations that do not occur: concept-construction tasks, 
concept-usage tasks, or instance (number) -construction tasks • Eighteen 
categories of exercise tasks were left plus one category labeled 
"Giveaway," which included items in which the correct answer is explicitly 
given to the student* Two categories of exercise tasks do not occur in 
the first I50 lessons of the curriculum, so there are I7 tasks included 
in the present analysis* These tasks are listed in Table l6# The table 
also lists the number of items included under each task (N) and, for deaf 
and Indian students, the difficulty ranking (Rank) as well as the pro- 
portion of correct answers for each task (PCA)* Kendall's rank coefficient 
was calculated for the difficulty rankings of the two sets of data* This 
statistic indicated that the difficulty rankings of exercise ta'^7ks for 
the deaf and Indian subjects were similar (p < *05) or, more precisely, 
not independent (r = *37, S = 50, N = 17)* 

Four more general categorizations of the exercise tasks were also 
investigated* These categorizations were derived from the four dimen- 
sions of exercise task classification listed earlier* Table I7 shows 

60 



Table l6 

Number of Items (N), Difficiilty Ranking (Rank), and Percentage 
of Correct Answers (PCA) for 17 Exercise Tasks 



Deaf Subjects Indian Subjects 

Task N Rank PCA Rank PCA 

Instruction, number, 25 •8UI 15 .88U 

recognition, usage 

Instruction, number, 2U8 I6 .810 1? .829 

recognition, definition 

Instruction, text, 208 10 .867 5 •9'*6 

recognition, usage 

Instruction, text, 2U6 I7 .810 I6 .875 

recognition, definition 

Instruction, concept, 52 9 .873 12 .907 

recognition, definition 

Instruction, text, 72 7 -878 9 .925 

construction explicit, 
definition 

Instruction, text, 12 15 .818 k .95O 

p construction implicit, 
usage 

No instruction, number, 8 8 .873 ih .896 

recognition, usage 

No instruction, number, 2h 13 .851 7 .91*2 

recognition, definition 

No instruction, text, 89 6 .897 10 .92U 

recognition, \isage 

No instruction, text, 225 11 .867 3 .951 

recognition, definition 

No instruction, concept, 113 5 .90^* 8 .927 

recognition, definition 
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Table l6 (cont'd) 



Deaf Subjects Indian Subjects 

Task N Rank PCA Rank PCA 

No instruction, text, 73 k .905 I3 .900 

construction explicit, 
usage 

No instruction, text, 5 2 .Ski 2 .955 

construction e^qplicit, 
definition 

No instruction, text, 5^ 12 .865 11 ^911 

construction iaiplicit, 
^l8age 

No instruction, text, 10 3 •93^ 6 .91^5 

construction implicit, 
definition 

Giveaway 3 1 .91^1 1 .971 
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Table 1? 



Comparison of Mean Difficulty Rankings for the 
Four Dimensions of Exercise Tasks 





ifUniDer or tasKs 


Mean rank for 

OieclX oUuJcCuo 


Mean rank for 

TnH^ An ati^lpr^'^a 


Instructions 


7 


12.57 


11. lU 


No Instructions 


9 


7.11 


8.22 


Hann-Whitney U 




3.00* 


13.00 


In8tance-*number 


h 


Xd. f ? 




Instance-text 


10 


8.70 


7.90 


concept 


2 


ll+.OO 


20.00 


Kruskal-Wallis H 




15.1+0* 


16. 3^^* 


Recognition 


10 


10.90 


10.70 


Construction-Explicit 


3 


^+.33 


8.00 


Const nictl on-Implicit 


3 


10.00 


7.00 


Kruskal-Wallis H 




17. 1^+* 


ll+.l+7» 


Usage 


7 


9.86 


10.29 


Definition 


9 


9.22 


8.89 


Mann-Whitney U 




25.00 


19.00 


^Significant, p < .01; 


U 9^(7,9) = 8; H 


.99(2) = 10.6. 
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the mean difficulty rankings associated with each cf these classification 
dimensions for both groups of subjects. As Table 17 indicates, three of 
the four classification dimensions were significantly related to exercise 
task difficulties. The presence or absence of instructions was related 
to the exercise-task difficulty rankings for deaf subjects (p < .01) but 
not for Indian subjects. Requiring instance-number, instance- text, or 
concept and requiring recognition, construction-explicit, or construction- 
implicit were both significantly related to the exercise-task difficulty 
rankings for both deaf and Indian subjects (p < .01). 

Correct answer fomat . There were three dimensions of classifica- 
tion based on correct answer formats. 

1. Word or letter or niimber or abbreviation. There was some 
"nesting" under this dimension: word was classified as 1-, 2-, 3-^ 

or l|-word strings; letter was classified • 1-, 2-, or 3-letter strings; 
and number was classified as 1-, 2-, 3-, or 5-number strings. Abbre- 
viations presented a problem in that they could reasonably be classified 
as single letters, multiple letters, or single words. It was decided 
that abbreviations would confuse the single letter, multiple letter, or 
single word results, and they were treated separately in the exercise- 
fomat data analyses. 

2. Sequence or no sequence. In some instances, the sequence of a 
multiple word, multiple letter, or multiple- number response is important; 
in some instances sequence is not important. This diir.ension distinguished 
between these instances. 

3. Copied or constracted. If the elements for the correct answers 
are all present in the item display, the correct an^iwer was clai;sified 
as copied. Otherwise, it was classified as constructed. 
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Classified in this way, 18 correct answer fomats occurred in the 
language arts curriculum* Sufficient data were available to include l6 
of these formats in the present analysis* These formats are listed in 
Table l8, which also lists the number of items included under each format 
(N) and, for deaf and Indian students, the difficulty ranking, of each 
format (Rank) and the proportion of correct answers for the formats (PCA). 
Kendall's rank coefficient, which was calculated for the difficulty 
rankings from both sets of data, indicated that the two rankings wert 
independent ( r = . 30, S 36, N ^ l6) . 
Discussion 

The intent of the item analysis was descriptive, and it is difficult 
to say if useful dimensions of problem difficulty have been identified. 
The lack of agreement between the deaf and Indian subjects on the three 
item difficulty rankings clearly indicates that different populations of 
students were involved in this investigation, and that the tasks posed 
by the items to the deaf students were quite different from the tasks 
they posed to the Indian students- The authors' subjective impression 
was that the lack of intuitive clusters uf rankings in all three clas- 
sification schemes indicated that more precise experimentation will be 
necessary to reveal true and cognitively meaningful dimensions of problem 
difficulty appropriate for the populations investigated here. 
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Table 18 

Number of Items (N), Difficulty Ranking (Rank), and Percentage 
of Correct Answers (PCA) for 16 Correct Answer Foimats 







Deaf Subjects 


Indian Subjects 


Fomat 


N 


Rank 


PCA 


Rank 


PCA 


One word, copied 


597 


1 


• od2 


d 


• 935 


Two words, no sequence, 
copied 


16 


10 


• ojO 




.037 


Three words, no sequence, 
copied 


1 


1 


• y2b 


9 


• 002 


Two words, sequence, 
copied 


60 


Ik 


.787 


15 


. .825 


Three words, sequence, 
copied 


18 


3 


.885 


3 


.928 


One word, constructed 


150 


i> 


.872 


1+ 


.923 


vjne xe x xe r , copie u 




11 


.808 


1 


.950 


Two letters, no sequence, 
copied 


8 


13 


.792 


8 


.902 


One nvunber, copied 


133 


9 


.835 


11 


.869 


Two nvunbers, no sequence, 
copied 


51 


16 


.7^+9 


13 


.831 


Three nvunbers, no sequence, 
copied 


7 


15 


.770 


10 


.871 


Two nvunbers, sequence, 
copied 


7U 


8 


.858 


11+ 


.830 


Three nvunbers, sequence, 
copied 


92 


1* 


.873 


7 


.901+ 
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Table l8 (cont'd) 



Format N 

Four niunbers, sequence, 26 
copied 

Five niunbers, sequence, 6 
copied 

Abbreviation 210 



Deaf Subjects Indian Subjects 

Rank PCA Rank PCA 

12 .Qoh 16 .807 

6 .871 5 .918 

2 .886 6 .909 
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APPENDIX A 

Third Grade Vocabulary List for the Language Arts Course 



able ADJ. 
about ADV. 
across £R£P« 
act V. 
afraid ADJ. 
after PREP, 
afternoon N. 
again ADV. 
against PREP, 
an DET. 
almost ADV. 
alone ADJ. 
along PREP, 
also ADV. 
always ADV. 
an V. 
and CONJ. 
angry ADJ. 
another DET. 
any DET. 
apple N. 
are V. 
arm N. 

around PREP, 
asleep ADJ. 
as ADV. 
ate V. 
at PREP, 
aunt N. 
away ADV. 
a DET. 



baby 

back ADV. 
bad ADJ. 
ba$ H. 
ball N. 
bank N. 
bang INT. 
basket U, 
bear N. 

beautiful ADJ. 
beat V. 

1 
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because CON J. 
bed N. 

before PREP, 
began V. 

behind PREP, 
below PREP, 
bell N. 
best ADJ. 
better ADJ. 
between PREP, 
be V. 

bicycle N. 
big ADJ. 
bigger ADJ. 
birthday N. 
bite V. 
bit V. 
black ADJ. 
blanket N. 
blew V. 
block N. 
blue ADJ. 
boat N. 
both DET. 
bottom N. 
bought V. 
box N. 
boy N. 
brave ADJ. 
bread N. 
break V. 
breakfast N. 
bring V. 
bright ADJ. 
brown ADJ. 
brook N. 
brother N. 
broken V. 
brou^t V. 
built V. 
busy ADJ. 
business N. 
but CONJ. 
butter N. 
by PREP. 



cage N. 
call V. 
came V. 
can V. 
candy 
cart 
car N, 
carry V, 
care V. 
castle 
cat K. 
catch V. 
caught V. 
cheese 
children N, 
chief N. 
circus N. 
city 

clean ACJ. 
clever ADJ. 
climb V, 
close V, 
clop INT. 
clock N. 
clothes N. 
cloud N. 
cloth N. 
coat N. 
cold AIXJ. 
come V* 
coining V, 
cool ADJ. 
com N. 
comer 
course ID. 
could V. 
country N. 
cow N. 
cried V, 
crowd N. 
cry V, 
cup N. 
cut V. 



danger W, 
dark ADJ. 
day W. 
deer N. 
deep ADJ. 
did V. 

different ADJ. 
dig V. 

dinner 
does V. 
dog N. 
door N. 
down ADV. 
do V. 
dress N. 
drink V. 
drive V. 
dry ADJ. 
duck N. 



easy ADJ. 
eat V. 
edge N. 
egg N. 
eight Dh'n:. 
either COWJ. 
elephant N. 
else ID. 
empty ADJ. 
end N. 
engine W. 
enough ADV. 
ever ADV. 
every DET. 
even ADV. 
evening N. 
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face N. 
fall V. 
family 
farm N. 
far ADV. 
farmer N. 
fast ADV. 
faster ADV. 
fat ADJ. 
father W. 
feather 
feed V. 
feet N. 
feel V. 
fell V. 
felt V. 
fence W. 
few DET. 
field N. 
fill V. 
fine ADJ. 
find V. 
finger N. 
first ADJ. 
fire N. 
fish N. 
five DET. 
flag N. 
flew V. 
fly V. 
foot W. 
food N. 
foolish ADJ. 
for PREP, 
forest N. 
forth ID. 
four DET. 
found V. 
free ADJ. 
fresh ADJ. 
friendly ADJ. 
friend N. 
from PREP, 
front N. 
fruit N. 
fun ADJ. 
fun N. 
Ainny ADJ. 



garden W. 
gate W. 
gave V. 
get V. 
give V. 
glad ADJ. 
glass W. 
goat N. 
going V. 
gone V. 
good ADJ. 
got V. 
go V. 
grass N. 
gray ADJ. 
grandmother N. 
grandfather W. 
green ADJ. 
grew V. 
great ADJ. 
ground W. 
grow V. 
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had V. 
hair N. 
happy ADJ. 
hard ADJ. 
has V. 
hat h. 
have V« 
hear V. 
head N« 
heavy ADJ. 
heard V, 
held V. 
help V. 
hello INT. 
hen N, 
her DET. 
here ADV. 
he PRO. 
hide V. 
high ADJ. 
hill N. 
him PRO. 
himself PRO. 
his DET. 
hit V. 
hole 
hold V. 
home N. 
hope V. 
horse N, 
hospital 
hot ADJ. 
house N. 
hov ADV. 
huge ADJ. 
hunt V. 

hungry ADJ. 
hurry V. 
husland N. 



idea N. 
if CONJ. 
important ADJ. 
Indian N. 
into PREP, 
in PREP, 
is V. 
its DET. 
it PRO. 
i PRO. 



job W. 
jump V. 
jumped V, 
just ADV. 



keep V, 
kept V. 
king N. 
kind W. 
kitten 
kitchen N. 
knew V. 
know V. 



lake N. 
land N. 
last ADJ. 
late ADJ. 
lauehed V. 
lay V. 
lazy ADJ. 
led V. 
left V. 
let V. 
letter IV. 
life N. 
lift V. 
light W. 
line N. 
lion N. 
listen V. 
little ADJ. 
log W. 
long ADJ. 
loose ADJ. 
lost ADJ. 
lose V. 
lot ID. 
loud ADJ. 
love V, 
low ADJ. 
lucky ADJ. 
lunch U, 
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machine N. 
made V. 
make V. 
man N.DET, 
march V. 
matter N. 
may V,* 
meat K. 
mean V. 
meet V. 
men N. 
met V, 
me PRO. 
middle N. 
might V. 
milk N. 
minute N. 

mind V. 

mirror N, 

miss V. 

money N. 

more D£T. 

most PRO. 

mother 

mouse N. 

mouth N. 

mountain H. 

move V, 

mrs If. 

mr N. 

much ADJ. 

must V. 

my DET. 



near PREP, 
nearer PREP, 
neck N. 
need V. 
never ADV. 
new ADJ. 
next ADJ. 
nice ADJ. 
night N. 
noise N. 
north N. 
nose N. 
not ADV. 
nothing PRO. 
now ADV. 
no DET. 



oak N. 
off ADV. 
office N. 
often ADV. 
of PREP, 
oh INT. 
old ADJ. 
once ADV. 
one DET. 
only ADJ. 
on PREP, 
open V. 
or CONJ. 
other DET. 
our DEI", 
out ADV. 
over PRFP. 
owl N. 
own ADJ. 
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pail N. 
paint V. 
palace lU 
paper N. 
park N. 
part N. 
parade 
path 
pav N* 
pay V. 
pen 

pencil N. 
penny N. 
people 
perhaps ADV. 
pet a. 
picnic 
pie h. 
pilot N. 
pile N. 
pink ADJ. 
play V. 
place N. 
please INT. 
policeman N. 
polite ADJ. 
pole N. 
poor ADJ. 
pop V, 
porch N. 
pretty ADJ. 
prince N. 
princess N. 
prize K. 
pronise N. 
proud A£J. 
pull V. 
pumpkin N. 
put V. 



rabbit IJ. 
race N. 
rain N. 
ran V. 
rang V. 
read V. 
really ADV. 
ready ADJ. 
real ADJ. 
red ADJ. 
remember V. 
rest N. 
ride V. 
right AEJ. 
ring N. 
river N. 
road N. 
rode V. 
roof N. 
room N. 
rope N. 
round ADJ. 
row N. 
run V. 
running V. 



queen N. 
quiet ADJ. 
quick ACJ. 
quite ADVo 
quickly ADV. 
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sad ADJ. 
safe ADJ. 
said V. 
salt N. 
same ADJ. 
san£ V. 
sat V. 
Saturday N. 
save V. 
saw V. 
say V. 
scare V. 
school 
sep. 

seat N. 
second ADJ. 
secret 
see V. 
seen V. 
sell V. 
sent V. 
send V. 
set V. 
seven DET. 
several D£T. 
shall V. 
she PRO. 
short ADJ. 
shot V. 
shock V. 
shoulder N. 
shop V. 
shC!'JLd V. 
shut V. 
side N. 
si^t N. 
silver N. 
silly ADJ. 
sine V. 
sister N. 
sit V. 
six DET. 
sky N. 
sleep V. 
slowly ADV. 
snail ADJ. 
SBile V. 



snow N. 
soft ADJ. 
some DET. 
something PRO, 
sons W. 
soon ADV. 
sorry ADJ. 
soup N. 
sound N. 
so ADV. 

spend V. 
splash V.' 
spoke V. 
spring IJ. 
spread V. 
stay V. 
station N. 
stand V. 
utep N. 
still ADV. 
stick N. 
stop V. 
stopped V. 
stood V. 
store N. 
stor^ N. 
stories N. 
strong ADJ. 
strange ADJ. 
street N. 
straight ADJ. 
such ADJ. 
suddenly ADV. 
sugar N. 
summer N. 
sun N. 
supper 
sure ADJ. 
sweet ADJ. 
swim V* 



table N. 
tail N. 
take V. 
tall ADJ. 
talk V. 
teacher 
tell V. 
telephone N. 
ten DET. 
terrible ADJ. 
that PRO. 
than COKJ. 
the DET. 
them PRO. 
these DET. 
then ADV. 
there ADV. 
their DET. 
this DET. 
think V. 
thought V. 
three DET. 
through PREP, 
threw V. 
thunder N. 
time N. 
tiny ADJ. 
tired ADJ. 
today N. 
together ADV. 
told V. 
tomorrow N. 
tongue N. 
too ADV. 
took V. 
top N. 
town N. 
toward PREP, 
to PREP, 
trade V. 
train N. 
trap N. 
tree N. 
trip N. 
tried V. 
truck N. 
trunk N. 
try V. 
turn V. 
twelve DET. 
two DET. 



uncle N. 
under PREP, 
until CONJ. 
up ADV. 
use V. 
us PRO. 



very ADV. 
village N. 
visit V. 
voice N. 
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wagon N. 
wait V. 
walk V. 
wall K. 



yard N, 
yellow ADJ. 



yes INT, 
yet ADV. 
you PRO. 
your DET. 



wanted V. 
warn ADJ. 



was V. 
water N. 
way N. 
wear V. 



young ADJ. 



well ADV. 
went V. 



zoo N. 



were V. 
west 
wet ADJ. 
we PRO. 
what PRO. 
when ADV. 
where ADV. 
wheel N. 
which ADJ. 
white ADJ. 
while CONJ. 
who PRO. 
whole ADJ. 
why ADV. 
wide ADJ. 
wife N. 
will V. 
wild ADJ. 
winter M. 
window N. 
win V. 
wind N. 
wing N. 
wish V. 
wise ADJ. 
with PREP, 
woke V, 
wolf N. 

wonderful ADJ. 
wonder V. 
work V. 
world N. 
word N. 
would V. 
write V. 
wrong ADJ. 
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APPENDIX B 

CUTLINit OF LANGUAGE ARTS FOP THE DEAF 

(1972 - 75 VERSION) 



Berr copy miABii 



Lttton Name 



1. 


IMTROD 


Int poduet 1 on 


to tht 


eeurto 






i. 


OXRt 


C< rectlons 1 




•oeond# 


loot lottor 




3. 


0IR2 


01 peetl onti 


• f top 








a. 


0IR3 


D1 i*«etienti 


f < ptt# 


•oeondf 


th<pd» feurthy 


loot MOPd 


5. 


OXRtt 


rtetlonti 


of toff 


bof OPOf 


wopdi 




6. 


DIRS 


H ptetlenii 


f <i»st» 


•oeondf 


th<Pd» fourth^ 


lottr 



7, 
8, 



DIR6 
0IR7 



oftop tHo fUttf bofoco tho lOtty lottOff 

DiPffCtlensI moro thoi^ eno word (ODoeot botMOon) 

OlPoetfenii mopo thofi eno MOPdi f<Ptt» toeond* tH<Pd» 
foupt^y lotty boforo tho loot MOPdt 



9. 


DXRB 


0<poet<ensl bolowy undop 


10. 


0XR9 


D<Poet<onti obove» bo1ew» undop 


It. 


RTA 


Rovlow toot 


12. 


NAA * 


Coptmon neuntf <ntPeduet<on 


15. 


NAB 


Cen^wop neuntf eontlnuod 


la. 


DAA 


Dotopi^lnoft Intpodweod (o» on^ tho) 


15. 


MAA 


**i»9Q dpnil 1dont< f Uotlon of nount ond doto^nlnopo 


U. 


MAS 


MUod dpHli Aount ord dotopfflROPt 


17. 


MAC 


MUod dpnii '^ount ond dotorfwlnort 


16. 


LAA 


VOMoU <ntP0ducod 


19, 


DAB 


Cotcpm^noptl uto of ond "on" 


20. 


MAO 


XdoPt< f Uotlon of nount ond dotofm^noPt 


21. 


RTB 


Rovlow toot 


22. 


N^AA 


Intpeduet^On of noun phpoto (dotopm^nor noun) 


23. 


NPAB 


Noun phPoto (tlnglo noun) 


2a. 


OAC 


Copdinolt 01 dotoPff><njiPt 
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25, 

26, 

27, 

28. 

29, 

30, 

3i 

32 

33. 

3a, 

35. 
36. 
37. 
38. 
39. 
40 

ar 

42. 
43. 
44, 
45, 
46. 
47. 
48, 
SO, 

9i 

S2 

S3, 



NAC 
NAO 
NAE 
MAF 
NAG 
NAH 
RTC 
DAD 
MAE 

NPAC 

DAE 

DAF 

DAG 

VAA 

VAB 

MAF 

VAC 

HAG 

RTD 

VAD 

AJAA 

AJAB 

MAH 

MAX 

NPAD 

NPAE 

NPAF 

AJAC 



ICST corf AVAll>Bl£ 
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Plurtl ftount <i^treduetcl 
Plufil nouns (-•) 

P1U^«1 nouns im$, sAt) 

P1UP«1 nouns ("Its) 
Plufsl ncunsf all types 
Plufsl nounsi l^ragulsp 
HevUw test 

Dstef ml nt r>-noun aqref^ent In numbsp (ont#two) 

Idtnt< f lestlon o^ nouns snd dttepmlners 
(seift^ evefvi n^) 

Rsv<«M noun phpssss (Inelud^nq ntw dtternlners) 

Deterri ntpanoun tgrttfitnt (s# sent) 

Ntv<tM d«ttpjt*1 ntps (s# semt) 

DstftPn^lnop noun tgpttmtnt (s# sn* som^) 

Verbs introduced (one«wefd veros) 

OneaMOPd verbSf Indent^ f leatlon 

Mixed revlewi vefbs# detepminarsf nouns 

Review one end two word verbs 

Mixed drill I Identify noun phrases and verbs 

Review test 

Models Introduced es oert of two word verbs 
Adjeetlves Introduced (co1or# shroe end slit) 
Adjectives (Identity two In sentence) 
Mixed drilll nouns^ adjectives^ detern1ners# verbs 
Mixed drilll nogns^ edjectlvesy detepn1ners# verbs 
Identify noun phrases with edjectlves 
Noun phreses with edjectlves 
First end second noun phrases 
Predleete edjectlves Introduced 

2 



5tt. 

96. 
57. 
56. 



62. 

65. 
66. 
67. 
68. 
69, 
70. 
71. 
72. 
73. 
74. 

75, 
76. 
77, 
78, 
79, 



RTE 
NPAG 
NPAH 
NPAX 



59, NP4J 



60, NPAK 



61, NPAL 



AJAD 

AJAt 

AJAF 

AJAG 

RTP 

SAA 

SAB 

PNAA 

PNAB 
NPAM 

SAC 

PNAC 

PNAD 

NPAN 
PNAE 
PNAP 

«TC 
MAK 



ERIC 



BEST COPY AVAIIABLE 

M1x«d fevUwi noun pHfattt and vtpbt 
RevUta tttt 

Nomlnatlvt noun pHpatts (i*Mhoi*f '*what" quattlont) 

Objtctiv* noun phfaset ("w^at** ouattlent) 

Objaetlva noun phfatet (*'Mhat" Quettlont without 
advarbUU In Question) 

No'ninatlva and obJaet<va noun phnatat (*'who'*» 
''what" auastiont) 

Nofninatlva and objactlva noun phnatat ("who**! 
"what" Quettlent) 

Nen*4nat4ve and objaetlva noun oKpatat ("Mho'# 
"what" auattlont) (without advopblalt In qutatlon) 

Adjaetlve tfantfopm Intfoduetd (tubjaet noun DhPaaa) 

Adjeetlva tpantfofm (oofcltlon of adjaetlve) 

Adjaetlva tfantform (ebjact noun ohpatt) 

Adjoetlve tpantfofff* (petition of adjaetlvo) 

Ravlew teat 

Sentaneaai aubjaet and opadleata Intpoduead 

Subjact and ppad1eata» eentlnuad 

Pponouna Introduead (X» yeu» wa» ha» aha» Itr thay) 

Pponount intpoducad (ma# h1m# hap^ 1t» ua» tham) 

Pponouna at noun Phnaaaa 

Subjoet and pnadleatt (pponoun aubjaeta) 

pponognaantaeadant agpaamant (ha» aha» It) 

Pponoun-antaeadant agPtamant ('*htp fathapf** 
"hit alatap") 

Ravlaw alngulap and plupal noun Phpataa 
Pponoun«antaeadant agptamtnt (1t» thav) 
pponoun>antaeadant aopaamant .(Ka» aha» 1t» thay) 
Ravlaw taat 

Hlxtd pavlawl IdtntHy nouna and pponouna 

3 



«f<^ corf ^v^llABtE 



«0, 


HAU 




ei« 




Ppof^oup^«>aBt0e«d0P^t agpeamef^t ( 1 1 1 than) 




PNAH 


Ppo^eun»ant0e«d0P^t agptemtf^t (h«p# him^ it$ tHam) 




SAD 


K«v40W tubj^et and DPedleata 




PNAI 


Ppor^oun^ar^taetdant agpeamant (thai hap# hai him) 




PNAJ 


Pponouf^*ap^tae«dar^t agpaafPtnt (t Hafn# thay) 


86, 


PNAK 


Ppo^eun«antacadant agpaainant (t ham# thay) 
(aofv^a eo^Dound aubjaeta and objeeta) 


67« 


PNAL 


Ravi aw of all pponeun^antaeadant agpaan^ant 


96 • 


PTH 


Ravi aw taat 


09, 


NPAO 


Slngglap and Diupal noun phpaaaa# Including pponouna 




OAH 


Data PIP Inap 1 ntpoduead (all) 


91, 


DAI 


OataP^I nap^roun agpaa^ant (a1 1 # avapy) 


92, 


DAJ 


Oeubia datapfv^lnapa (with '^alP and capolnala) 


93, 


MPAP 


Singulap and plupal noun phPaaaa 


94, 


NAt 


Pavlaw Ippaoulap olupal nouna * 




DAK 


Revltw dtttrmlntr ngmbtp (■» a^r temtf e«rd4n«1t) 


96, 


NAJ 


Plural nount with ■■ma forn ■§ tlnoMltr 




NAK 


HiMed P«v1«w of pluPtl nogni 


96. 


DAL 


Slnaul'^p a^^d plural noun php^iot (utlno "tono" and 
"tvary") 


99, 


HTI 


Pavlaw taat 




SUAA 


Idantify aubjaetai aena aantaneaa baolnning wltn 
advtpba 


■ ~ # 9 


9UAB 


Slnoulap and olural aubjaeti 




5UAC 


9inauiar ana piurai aubjactt 


lesg 


8UA0 


Cenpound aubjaeta Intpoduead 


i04t 


SUAE 


Sinfiulaf and plural aubjaeta^ aema eonpeund 


109, 


8UAF 


Munbap of aubjact) aoina aantaneaa with advapba 



ERIC 



ERIC 



BEST COW mmii 

10^« VAC Sukj0et*verb agpeentnt (cHoott tht vtPb) 

107« VAF dubJtet-vtPb agptftintnt (cHoost tht twbjtet) 

10fl« VAC $ubj0et«V0Pb «gpttnt0nt (tQmt ppenaun tubitett) 

(ehoott tK« vtPb) 

109, HTJ ^evUw tttt 

iiO« VAH SubJ«et*vtfb agptamaritf tent DPev^oun tubjaett In* 

including i*!** and nyou" (cboota tht vtPb) 

Ul« VAI $ubj«et*vepb •gi*e0i«>0nt y tema oponoun twbjtett 

(ehoote tH0 subject) 

112, VAJ SubJtet'VtPb igpttmtnt} compound tubjoett 

(cHooto tho v«pb) 

lis, VAK 8ubjtet*v«ph agpoomcntf pIupiI ootiottlvo pponouni 

w<th tlngultP tubjoctt (choete the vopd) 

U4i VAL Subject«vepb egpeei«>entf tevepel kindt of subjects 

(choose the vepb) 

U5« VAH $ubject«vepb sgpee^ent (cHeose subject op vtPb) 

Xibt 5UA6 ^umbep of subject! some Ippegulsp nouns 

U7« 8UAH Numbep of subject! some nouns with seme slngultP end 

olupel 

iia« RTK RevUw test 

119a VAN Subject«vepb egpeementf some nouns with sane sfngulap 

end plupel (choose the vepb) 

120« VAO SubJeet«vePb agpeement (choose subject op vopb) 

121« VAP Y*Us l^^fleetlons IntPOdueed 

122« VAQ S»fopr of vePbs enolng In yi cpy> stey> etc, 

|23« VAK «es Inflection of vepbs ending In •ch> "sh^ "S^ ■! 

12«« VA8 Spelling of ^es end s«fopms 

129« VAT Dpi 11 on s«fopmsy go«goes end do'does IntPodueed 

12*« VAU S*fepm of HAVE IntPOduced 

127t VAV Hi«td dpill en s^fopmy change fpom plupal ta slngulap 

subjects 

120, RTU* Review tMt 

129« PHAA Intpoduce ''opeposi ton" (1n> te> of) 

5 



BEST COPY AVAIWBLE 



130« PRA0 IdtntHy ertpotuioni (fntrodue* for» w4th» on) 

131. PRAC I«tfodgcf "prtpoiU < on«1 phftit" (cily P»EP OET ^) 

132. PRAD Idtr^tHy pPtoet 4 1 4 enal php«t9i (Ir^tPoduea at* byi 

133« PRAt Idtntlfy PPepoiHIc^at pnraiei of lovopal fopx^ai 

PREP K, PRfcP Oil K, PREP ADJ N, PREP OET ADJ N 

134, PRAF XdtntHy ppapoti tlonal phraaaa of aavtral forma 

(IntPoauea afttp» 4nto» ovaf» bafera) 

13Sa PRAG IdartHy flpat op saeond orapoal tlonal DhPaaa 

136a 8EAA iFttPOfluea "laaapa" forma (MitH eompouf^d tubjaata) 

137, BEAB "Uf" "am," "ara" wUh varloua aubjaeta 

136, BEAC Rav<aw 'Hay" "ara" with eo'^atpuetad anawara 

139, RTH Ravlaw taat 

UO, VAW Subjact-yapb (^a) agpaamantt aema fa*am«af>a (eheoaa 

t^a yapb) 

UU VAX SubJaet«vaPb (-aa) agraamanti aoma 4a»am*apa (ehooao 

tha vapb) 

142, vAY Subjaet*yapb agpaamarty aoma U*am«apa (cHooaa 

tha noun op Pronoun) 

143, VAZ SoalHng of a«fopnaf dpHI on and "apa" 

144, VBA Ray<aw of a«fopmai HAVE» 60» 00 

145, VBB Rav<aiN of a*fop|Hii HAVE, 60» OOt eonatpuetad anawapa 

146, PRAH Ida^tlfy ppapoaf t < onal pHpaaaa of plaea 

147, PRAI Ppapoaltlonal phpaaaa of plaea (fill in mUafng 

ppapoaltlon) 

146, PRAJ Ppapoiltlonal phpaaaa of plaea (ehooat eoPraet 

ppopoaltlon) 

149, RTN RavUw taat 

150, PRAK Idantify ppapoaf t lonal phpaaaa of t4ma 

ISlt PRAL Ppopoaltlonal phpaaaa of tima (fill In mlaaino 

ppaposltlen) 

192, PRAH Ppopoaltlenal phpaaaa of tlma (ehooaa eoppaet 

ppapoaltfon) 



ERIC 



BEST COPY AVAIUBLE 

A 

1S1« VBC Xntpoduee p«tt ttnst 

1S4, VBD Patt tertt* eentt puet i en C«dd<^o and ocd) 

ISb. VBE $D0lHna of y«l0d past tanaa 

156, VBF SDalHng of oaat tanna w<tK doubling of eonaonant 

157« VBG Ktvfaw of paat tanaa; alae HAVE» 60» DO 

156, VBH Ravlew of paat tanaap varloua verba 

159« VBI CHanga a«fopm to almpla form of varb 

160« RTO Oavlaw taat 

161, VBJ Fraaant PartUlplaal "1ng«fepmi Intpoduead 

U2« VBK 1nq*fopfiia with doubling of eenaenant 

16i, VBL 1ng»fopma wUK dpopplng of final 'a* 

U4, VBM Ravlaw 1ng«fopnai eonatpuetad anawapa 

16S« VBN Ppaaant ppodPaaalva aubjaet«vapb agpaanant 

166« VBO Ppaaant pfogpaaalvt aubjaet*vapb agpaamantp aoma 

conatpuetad anawapa 

167« VBP Ppaaant ppogpaaalve agpaawant MitH pponeunap aeioa 

eonatPuetad anawara 

Ue« VBQ ''Ppaaant ppogpaaal va" Intpodueadf eenatpuet bath eaPta 

U9« V6R CHanga fpon ppaaant to ppaaant ppogaaalvai eenatPuet 

botH paPta 

170, RTP Ravlaw taat 

171, $kl Nagatlva tpanafopmi "notwaantanea" 1ntP0due«d» «odaU 
6 9 SAP Magatlva tPanafopmi Intapt "net" eoppaetly 

173« NPAQ "poaaaaalva noun phpaaa" Intpoduead Caubjaeta only) 

174 NPAR Identify poaaaaalva noun phpaaea (aubjeeta and objaeta) 

175, NPA8 Peaataalva tpanafopni Identify eeppect aentenee 

17^1 NPAT Poaaaaalva noun pHpaae» aingulep neun^i eentrueted 

anawapa 

177« NPAU Poaaaaalva noun phpeaei pIupoI neunay conatPuetad 

anawapa 



ERIC 



176, RTQ Revltw test 



179i PRAK pPtD6S< t < en«1 php«sei of olaet and t<mt (ehoosa 

eopptet ppepoti t<or^) 

i80« PRAO Pptposltlo^al phraiai of olaet and tima (Insapt 

eoppaet ppapotHlen) 

Ult PRAP Ppaposltlonal phpasas of place and tine (InsePt 

eoppeet ppeDoslt^on) 

162. PRAQ Prepositional pKpases ("Mhen« questions) 

U3« PRAR Ppeposltlonal phpases ("toHtre" ouestlons) 

164, PRAS ppeposltlonal phpases CwHen" and "whepe" questions 

165, VBS Review past tense and ppese^t ppoqesslvef "edy "Ing 

166, VBT Past tense and ppesent progpesslvei -dy d^op 'e* ♦ In^ 

167, vau Past tense and ppesent progpesslvei y*1ed» double 

eonsonant vePba 

166« VBV Past tense and ppesent ppogpesslvei vaplous vepbs 

169. RTR Review test 

190* BEAD Centraetlons of BE IhtPodueeot Identify eontPaetlon 

191, 8EAE ContPaetlono of BE| pponeuns (eonstPueted answeps) 

192, BEAF BE eont Pact 1 ons | noun phpaset (eonstpucted answeps) 
19i, BEAG Change BE eontraetlonsi pponouns (eonstPueted answeps) 

194, BEAH Change BE eont pact 1 ons| noun phpases (eonstPueted 

answeps) 

195, NPAV Possessive pPonouns Intpodueed 

196, NPAW Possessive noun pHpase^ pponounsf eonstPueted answeps 

197, NPAX Possessive noun phpase» pponounsf eonstPueted answeps 
198* NPAY Possessive p^pef^f nouns and pponounsi eonstPueted 

199, RT8 Review test 

200, SAC Negative tpansfopwi fopins of HAVE and BE 

201, 3AH Negative tpansfopmi InsePt "net" In senteneei HAVE 

and BE 

8 
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BEST COPY WAlU^BLt 

202, SAI PfvUw ntgatlvtt t^nni^ofiff HAVfc» 8E# and '"odiU 

203, MAM Negative contract<o«i If^troducedi HAVE» BE» end DO 

204* HAN Negative eont ^eet 4 or^i I bi (cenetpucted enswere) 

20S« MAO MeQetlve ee^t reet 1 onet mavE* Bit DO (eonetpueted 

aptewere) 

20<»« MAP CHange negetlve contPaet<oi'«ei BE (eonetPueted ef^swePt) 

207. MAQ Cher«ge r^enatlve eont pact 1 enet havE» BE* DO 

(eonatpuettd answepe) 

206. kTT Review teat 

209, NPAZ Noun phpeaea CiMhOf** "what" queatlona) 

210a PPAT Ppepoti tlonel ohpeaea ('•w^'en#»' "whepe" queatfoPia) 

21U MAR Mixed pevlew ("who*" "what#" "wKeni" end "whepe" 

Queetlona) (thpee queatlena fop one etatement) 

212« MAS Mixed peview ("who*" "whet*" "when^i end '^whePt" 

Queetlona) (thpee Queationa fop one atatement) 

213« 8AJ Identify modeU heve-woPd op be«wepd 

214, 8AK Intpoauee oueation tpanafopr»f type modaW heve«woPd 

OP be^woPd (CA givea tpar^afoptn) 

215, SAL Oueation tPanafOP'««) "tyee the medal op the haye^woPd 

OP the be^wopd" (CA givea tpanafopm) 

2U« SAM Oueation tpenafopr**! identify eoppect aentenee 

217, RTU Review test 
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BEST COW MAIUBU 



165 L. J. Hubert. A formal mode) for the perceptual processir>9 of geometric conhgurations. February 19, 1971. (A statistical metfiod for 

investigating tfie percepiudl confusions among geometric configurations. Journal of Mathematical Psychology > 1972, 9, 389*403.) 

166 J« F* Juola, I. S. Fischier, C. T. Wood, and R. C. Atkinson. Recognition time for information stored in long*term memory. (Peaeption and 

Psychophysics , 1971, 10,8-14.) 

167 R. L. Klatzky and R. C. Atkinson. Specialization ol the cerebral hemispheres in scanning for information in shcrtHerm memory. (Perception 

and Psychophysics , 1971, 10, 335-338.) 

168 J. 0. Fletcher and R. C. Atkinson. An evaluation of the Stanford CAI program tn initial reading (grades K through 3). March 12, 1971 . 

(Evaluation of the Stanford CAI program in initial reading. Journal of Educational Psychology , 1972, 63, 597*602.) 

169 J. F. Juola and R. C. Atkinson. Memory scanning for words versus caUgories. (Journal of Verbal Learning and Verbal Behavior , 1971, 

10, 522-527.) 

170 I. S. FischJerand J. F. Juola. Effects of repeated tests on recognition time for information in long-term memory. (Journal of ExperimenUI 

Psychology , 1971, 91, 54-58.) 

171 P« Suppes. Semantics of context-free hragments of natural languages. March 30, 1971. (In K. J. J. Hintikka, J. M. E. Moravcsik, and 

P. Suppes (Eds.), Approaches to natural language . Oordiecht: Reidel, 1973. Pp. 221*242.) 

172 J. Friend. INSTRUCT coders' manual. May 1, 1971. 

173 R. C. Atkinson and R. M. Shiffrin. The control processes of short-term memory. April 19, 1971. (The control of short-term memory* 

Scientific American , 1971, 224, 82-90.) 

174 P. Suppes. Computer-assisted instruction at SUnford. May 19, 1971. (In Man and computer . Proceedings of international conference, 

Bordeaux, 1970. Basel: Karger, 1972. Pp. 298-330.) 

175 0. Jamison, J. 0. Fletcher, P. Suppes, and R. C. Atkinson. Cost and performance of computer-assisted instruction for education of disadvanuged 

children. July, 1971. 

176 J. Offir. Some mathematical models of individual differences in learning and performance. June 28, 1971 . (Stochastic learning models with 

distribution of parameters. Journal of Mathematical Psychology , 1972,^(4), ) 

177 R« C. Atkinson and J. F. Juola. Factors influencing speed and accuracy of word recognition. August 12, 1971. (In S. KomMum (Ed.), 

Attention and performance IV. rcwYork: Academic Press, 1973.) 

178 P. Suppes, A. Goldberg, G. Kanz, B. Searle, and C. Stauffcr. Teacher's handbook for CAI coteses. Sepleeter 1, 1971. 

179 A. Goldberg. A generalized instructional system for elementary mathematical logic. October 11, 1971. 

180 M. Jerman. Instruction in prablem solving and an analysis of structural variables that contribute to problem-solving difficulty. Novento 12, 

1971. (Individualized inslniction in problem solving in elementary mathematics. Jotamal for Research in Mathematics Education , 1973, 
4, 6-19.) 

181 P. Suopes. On the grammar and model -theoretic semantics of children's noun phrases. Noven^er 29, 1971. 

182 G.Kreisel. Five notes on the application of proof theory to computer Kience. Oecefi6cr 10, 1971. 

183 J. M. Moloney. An investigation of college student performance on a logic curriculum in a computer-assisted instruaion setting. January 28, 

1972. 

184 J. E. Friend, J. 0. Fletcher, and R. C. Atkinson. Student performance in computer-assisted instruction in programing. May 10, 1972. 

185 R. L. Smith, >. The syntax and semantics of ERICA. June 14, 1972. 

186 A. Goldberg and P. Suppes. /^computer-assisted instruction program for exercises on finding axioms. June 23, 1972. (Educational Studies 

|n Mathematics , 1972, 4, 429-449.) 

187 R.C.Atkinson. Ingredients for a theory of instruction. June 26/1972. ( American PsychologiU , 1972. 2^ 921-931.) 

188 J. D. Bonvillian and V. R. Charrow. Psycholinguistic implicaUons of deafness: A review. July 14, 1972. 

189 P. ArabieandS. A. Boorman. Multidimensional scaling of measures of disunce bebeeen partitions. July 26, 1972. (Journal of Mathematical 

Psychology , 1973, 10, ) 

190 J. Ball and D. Jamison. CompUcr-assisted instniction for dispersed populations: System cost models. Septen^er 15, 1972. ( Instructiona l 

Science, 1973, 1,469-501.) 

191 W. R. Sanders and J. R. Ball. Logic documenution standard for the Institute for Mathematical Studies in the Social Sciences. October 4, 1972. 

192 M. T. Kane. Variability in the proof behavior of college students m a CAI course in logic as a function of problem characteristics. October 6, 

1972. 

193 P. Suppes. Facts and fanusies of education. October 18, 1972. (In M. C. Wittrock (Ed.), Changing education ; Alternatives from educational 

research . Englewood Cliffs, N. J. r Prentice-Hall, 1973. Pp. 6-45.) 

194 R. C. Atkinson and J. F. Juola. Search and decision processes in recognition memory. October 27, 1972. 

195 P* Suppes, R. Smith, and Ul. Leveille'. The French synUx and semantics of PHILIPPE, part 1: lioun phrases. Noveftter 3, 1972. 

196 D. Jamison, P. Suppes, and S. Wells. The eHectiveness of alternative instructional methods: A survey. Noveti^, 1972. 

197 P. Suppes. A survey of cognition in handiupped children. Decefi6er 29, 1972. 

198 8. Searle^ P. Lorton, Jr., A. Goldberg, P. Suppes, N. Ledet, and C. Jones. Computer-assisted instruction program: Tennessee Sute 

University. February 14, 1973. 

199 D. R. Levine. Computer-based analytic grading for German grammar instruction. March lb, 1973. 

200 P. Suppes, J. D. Fletcher, M. Zanotti, P. V. Lorton, Jr., and B. W. Searle. Evaluation of computer-assisted instruaion in elemenUry 

mathematics for hearing- impaired students. March 17, 1973. 

201 G. A. Huff. Geometry and lormal lin^iistics. April 27, 1973. 

202 C. Jensema. Useful tKhniques for applying latent trait menul-test theory. May 9, 1973. 

203 A. Goldberg. Computer-assist d instruction: The application of theorem-proving to ao^ptive response analysis. May 25, 1973. 

204 R« C. Atkinson, D. J. Herrmann, and K. T. Wescourt. Search processes tn recognition memory. June 8, 1973. 

205 J. Van Camptn. A computer-based introduction to the morphology of Old Church Slavonic. June 9.8, 1973. 

206 R.B. Kimball. Self-optimizing computer-assisted Uitortng: Theory and practice. June 25, 1973. 

207 R. C. Atkinson, J. D. Fletcher, £. J. Lindsay, J. 0. Campbell, and A. Barr. Computer-asststed instruction m initial reading. July 9, 1973. 

208 V. R. CharroM and J. 0, Fletcher. English as the second languaoe of deaf students. July 20, 1973. 

209 J. A. Paulson. Ah evaluation of instructional strategies in a simple learn ng situation. Jul; 30, 1973. 

210 Martin. Convergence properties of a class of probabilistic adaptive schemes called sequential reproductive plans. July 31 , 1973. 



(Continued from inside back cover) 

211 J. Friend. Coinputcf-assisted instruction in pro9ramming: A curriculum description* July 31, 1973. 

212 S. A. Weyer. Fingerspelling by computer. August 17, 1973« 

213 B. W. Searle, P. Lorton,Jr., and P. Suppes. Structural variables affecting CAI performance on arithmetic i^ord problems of disadvanUged 

and deaf students. September 4, 1973. 

214 P. Suppes, J. D. Fletcher, and M. Zanoiti. Models of individual trajectories in computer-assisted insUuction for deaf students. October 31, 1973. 

215 J. D. Fletcher and M. H. Beard. Computer-assisted instruction in language arts for hearing-impaired students. October 31, 1973. 



ERIC 



